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PROGRAMMABLE COMPUTER GRAPHIC OBJECTS 
This application claims the benefit of U.S. Provisional Patent Application No. 
60/013,624, filed March 15, 1996, which is incorporated herein by reference. 

FIELD OF THE INVENTION 

5 The present invention relates generally to computer animation, and specifically to * 

interactive generation and manipulation of moving computer graphic objects. .... 

BACKGROUND OF THE INVENTION . - 

Computer animation systems and methods are well known in the art, serving a wide" : - :: 
range of applications in which a computer is used to generate and/or manipulate moving images. ' " - - T - 

10 In recent years, the rapid advance in computing speed and reduction in 'cost "of" personal r " ' r " H 

computers (PC's) has made computer animation widely accessible. Because of the^rHativ^ 0 - 5 } " :v — ^ f 
' heavy computation load associated with three-dimensional (3D) image rendering, **md§t bfWe''^ 051 ' t0? ^ associ; 
animation programs for PC's have been able to offer only 2D imaging or very limited ; 3D 5 feffek^ — ^ c ' s 
Similarly, although 2D animations are now commonly conveyed from one computer tb ; ^hbth^r : *- } ^ 2D ^:;imai=o 

15 over the Internet and other network systems, the bandwidth limitations of tfie^Internet fiave; ; ^t : " - - : a vc ^ other nsi\ 
least until recently, made it generally impractical to convey 3D animations. !;/ nr - :! rc"«*.":!y, n*:CvJ-:*it geno. 

Software tools and languages are available to assist programmers in creating^ c 9D vare *-"d iPr? 

animations. For example, "LightWave 5:0, H produced by Newtek, Inc., of Topeka/Kartia^ r is a r °^ e - r: i ; Us ' : 
software package that enables users to define and manipulate geometrical models ana : ariirfmtions i: *-:^ - n - " < rl "> , " Q 11 

20 of 3D graphic objects within a computer animation environment. Such objects atedefirf&f ohjects within a 
skeletons, or hierarchies of geometrical shapes that are connected together at jolhT^eThe&T -hierarchies" of gee 
objects may further include methods, or program routines, that define the basic rrrcvement^ include. incr 

the joints. Thus, an animated humanoid character may be defined by a skeleton incli]din^ r r<frs6r hus ' aiy animated hr 
head, arms, legs, hands, feet, and other features, with interlinking joints and niethbds n tKat ie £- hands, feet, : 

25 describe walking, running, hand-waving and other actions. Motion of the^characteT'^W^ 

desired path in a 3D virtual space may be engendered by indicating positions of the 6fefc&drffw7> in & 3D. virtual sp^cc 
or more key frames, whereupon the intermediate positions of the object between th£' 7 key^ra'iti& araes, whereupon 
are interpolated, using the appropriate methods belonging to the object. are ;r, te r no!aTed, usina i the .2pr>rc 

Based on the 3D geometrical definition of the object, an image of the animated charScfer 1 on the f,eornet 

30 is rendered on a computer screen. Various software packages are available for 3D rfeWe?fh% e fb? n 3" computer seres:: 
example, "RenderWare V2.0," produced by Criterion Software Ltd. of Surrey^^ 5ie >TIfe®" ia ^ rWare V2.0," 
rendering software typically takes into account the effects of light, shade, color, surfare1rH?ffi-gS: nware Vocally take, 
perspective and other visual elements, to create a convincingly "3D" image on the fTaFcofnputer nd Gther * '"--»■- 
screen. Generally, multiple 3D objects are rendered together, along with a suitable Ba^JcgroSfd^^y* miiliipie 3D < 

35 to form a single image on screen. . - , ' • . 35 . ■ /° <i SiiiA^e ir£?££ sr;r-:.;rt. 

U.S. Patent 5,261,041, to Susman, which is incorporated herein by reference, describb?a^ aient 5,2-: -,C1 \ * - 
computer-controlled animation system based on manipulation of animated objects. Each object 

I 
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includes state data and methods, or functions, defining the behavior of the object. The objects 
also have associated affect volumes and affect agents, or methods, that determine how they will 
interact with each other as an animation sequence progresses. The animation sequence is 
governed by a set of rules, graphs or scripts. The behavior of the objects in the sequence is 
5 modeled and rendered on a display screen. 

U.S. Patent 5,483,630, to Unuma et al., which is incorporated herein by reference, 
describes a method for representing motion of multiple-jointed objects, for use in computer 
animation. The bending angles of the joints of a multiple-jointed object are represented by 
functions expressed independently of the length between the joints. Based on the functions, 
10 contour data are produced representing the motion of the joints, which data are used in 
rendering the objects in computer animation sequences. Parameters of the functions can be 
adjusted so that the motion of the joints has a desired character, for example, running or walking 
motion, or motion having a manner intended to give a sense of an emotional quality. 

U.S. Patent 5,267,154, to Takeuchi et al., which is incorporated herein by reference, 
15 describes a system for producing "biological images," i.e., animated computer images of human 
and animal characters. Images are synthesized by combining data from several databases in 
which shapes, motions and external features and textures are stored. The system is used to 
produce a variety of 3D animated characters, which take part in computer-animated image 
sequences. 

20 u s Patent 5,577,185, to Tunnel! et al., which is incorporated herein by reference, ' 

describes a method and apparatus for creating computer-animated puzzles. The puzzles are 
made up of animated objects, such as structural members and characters, displayed on a 
computer screen. Each of the objects has a set of programmed physical and behavioral 
attributes, as a result of which the objects appear on screen to be aware of and to react to one 

25 another. They are programmed to appear to obey physical laws, such as the laws of gravity and " 
motion, and to exhibit natural tendencies, such as hunger and affinity. The puzzles are created 
by selecting the desired objects from a menu displayed on the computer screen. 

Computer-animated images may be overlaid on other images and/or windows on a 
computer display screen. For example, U.S. Patent 5,546,518, to. Blossom et al., which is 

30 incorporated herein by reference, describes a system and method for composing a display frame 
of multiple, layered graphic "sprites." A sprite is a graphic image that forms a part or a region of 
an overall computer display screen. The sprites are overlaid one above the other. The sprites 
preferably include transparent pixels in certain areas, through which underlying graphics can be 
seen. The system of sprites is used to combine video and/or animated images together with still 

35 images on a single screen. 

Recently, tools have begun to emerge for sending and receiving 3D animations over 
computer networks, such as the Internet, for example, Version 2.0 of the Virtual Reality 
Modeling Language (VRML 2.0), as described in "Moving Worlds," at http://vrml.sgi.com 
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(Silicon Graphics Inc.), and incorporated herein by reference. VRML 2.0 was developed by a 
group of companies to provide a language for creating animations in a compact form that is 
convenient for transmission over the Internet, and for viewing the animations at the receiving 
end. VRML 2.0 includes conventions for a user at a source computer to define and organize 
5 elements of an interactive animated image, such as 3D object geometriesr'surface Textures/ 
motion and action scripts and to encapsulate these elements for Internet transmission. When the 
encapsulated elements are received by a target computer having VRML-compatible network ' - 
browser software, the animated image created at the source computer is rendered on the target 
computer screen. 

10 Viewers of 3D animations generally require user interface software to enable them to 

observe and manipulate the animated images. Such software is known in the art, for example/ ~ :: 
"CosmoPlayer," a VRML 2;0-compatible network browser, available from Silicon Graphics at* - 
http://vrml.sgi.com, as described above. CosmoPlayer operates as a "plug-in" to an Triterhgt 1 ' 1 ^ 1 - 1 - u;: 
browser, such as Netscape "Navigator" or Microsoft Internet Explorer." CosmoPIa^fMables a ; ' 5 1 

15 user to view animations of 3D objects and to vary a point of view from which the animations are' 
rendered to the user's computer screen by means of "free navigation" in a virtual 3D space. 1 It" 
will be appreciated that because the computer screen and user controls are essentially twa- ca ' r - 
dimensional, "free navigation" is generally difficult for a non-expert user to master, ^ensionai, "free navigzuoi 
Computer-animated images may likewise be used to create an animated electronic 

20 meeting place, as described, for example, in U.S. Patent 5,347,306, to- Nitta, -which fis — u 

incorporated herein by reference. Each participant in a meeting has a terminal with ^restored ,ic < c:,t u ->' 
local animation graphics. The terminals are connected to a network, over which'the'iiieeting 0 " 
takes place. The meeting is shown on the display of each of the terminals usingTeal-trme " , "" , -' ! ' 
animated 3D graphic characters and sound, representing the participants' motions, expr^s'sidris ^4 t; ^ 

25 and speech. Each of the participants is represented in the animation by one of the* animated 

characters, having a persona which may be chosen by the participant. The char^ct^ : 7h r? th6' rvir ^ 
animated meeting are driven by sensors that sense the movement and speech <^4HHtetffiP ui ~ 
participants. The participants may also use view controls, such as a joystick, to zoorrv : 6r to-after 1 r ~ 7---v 
their viewing perspectives. n--«..:: 5 y^ ^^u^ 
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SUMMARY OF THE INVENTION 

It is an object of the. present invention to provide improved methods and apparatus for 
producing an animated image of an object, preferably a three-dimensional (3D) object, in a 
computer graphic display. 

Unlike computer animations known in the art, animated objects in accordance with 
preferred embodiments of the present invention are substantially autonomous, i.e., the objects 
includerules, preferably in the form of a scripting language, which are sufficient to determine 
how they will behave in a given scene. I n some aspects of the present invention, the objects 
correspond to humanoid characters, and the rules define social behavior of the characters in the 
scene, imparting human personality types to the ani mated characters . Furthermore, the animated 

: ■ — ■ — — " 

objects, including the rules, are modular, in that behaviors may be transferred freely among 
objects of a common type. The methods of implementation and the implications of this 
autonomy and behavioral modularity of animated objects are described below. 

It is an object of some aspects of the present invention to enable the image of the 3D 
object to be rendered as an overlay on a display generated by another software application, not 
necessarily related to the Scene Manager program, for example, an Internet Web Browser. 

It is a further object of some aspects of the present invention to provide methods and 
apparatus for representing an object by means of a modular set of parameters and/or data, which 
is transferred over a computer network from a source computer to a destination computer, 
whereupon an image of the object is produced in an animated computer graphic display at the 
destination computer. 

Preferably, the set of parameters and/or data is encapsulated and transferred in the form 
of an electronic mail message. 

It is another object of some aspects of the present invention to provide user interface 
methods and apparatus, for use in interactively viewing and controlling computer animations. 

It is an additional object of some aspects of the present invention to provide visual 
methods and apparatus enabling a user to search conveniently through a database or library of 
computer graphic objects, useful particularly in creating computer animations. 

In preferred embodiments of the present invention, computer animation apparatus 
comprises an animation generator, typically a computer, for example, a personal computer (PC). 
The computer has an associated video graphic display, memory and user input devices, such as a 
keyboard, mouse and/or joystick, as are known in the an. Preferably, the computer also includes 
a network connection, for example, a modem through which the computer is connected to the 
Internet. The computer is programmed to produce an animated graphic sequence, using 
methods described below, and the sequence is shown on the display. 

In preferred embodiments of the present invention, the animated graphip sequence is 
produced using 3D Smart Objects, as described herein. In the context of the present patent 
application, the term "object" is used to refer to a modular, graphic and/or mathematical 

4 
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description of an image element (generally a representation of a physical object, which may be * 
naturalistic or fanciful), whose representation may appear in the animation sequence. The term 
"Smart Object" as used herein, in accordance with preferred embodiments of the present 
invention, refers to an object comprising both the graphic/mathematical description of an image 
5 element and embedded ancillary information about the element. Such ancillary "information " 
preferably comprises procedures, typically in the form of scripts, which describe attributes, " " 
motion and behavior of the element, as described hereinbelow, and may also include other • 
information, such as textual reference data. "3D Smart Objects" include attributes of shape and 
motion that are used in rendering 3D images of the corresponding image elements. 

10 Each Smart Object preferably comprises a set of sub-objects in a predetermined 

hierarchy, which defines the relationships between the sub-objects. The hierarchy preferably 
includes a "skeleton," defining the parts of the body of the image element, the joints connecting : - - ; : ~^nr:q 
those parts, and the motions of the parts in animation. O ther components of the Sm art' OBi&r in 1 vnc n "suo;is o: 
describe attributes such as sound and rules governing behavior of the Smart oSj^^-Tlie^^- ^ ? - z -> ^ r - 

15 hierarchical structure of Smart Objects allows a user to exchange organs and sub-organs; as ; welf "* r ~ ■" ' 

as behaviors, between Smart Objects that share a common hierarchy. New Smart Objects may — " — 

be created by inheritance of attributes from an existing Smart Object. — - 1 '£\ [ "*■* - r:; . or r.ir: 

Image elements or characters that correspond to Smart Objects appear in a comjkite*- ^ chc.i 

animation sequence to move and function autonomously, based on the behavioral rules - 

20 embedded in the Smart Objects. For example, a sub-object of a Smart Object preferably " o: " : :v 
s pecifies an "idle" behavior, i.e., a motio n or other action that the corresponding ima^felemeht Ji^ ye^vior, i.e ... 
wilj undertake when the Smart Object has received no other progra m instmctitih^'fof*^^: vV " ert ln e ^T<v 
predetermined period of time . Preferably, the sub-objects in the hierarchy are chosen to impart a" ' ' - v ■ •"- 
desired "personality" to the Smart Object, wherein the personality comprises v a i; suitable 1 ^ 0 : jlh > U) ■> 

25 combination of physical appearance, facial expressions, characteristic movement and 4 gestures; 0: !™ v — ■ sppe*;;. 
voice and other attributes that a user will associate with a certain personality typ^: c ;Tuft1her n:er £""bu;es xhr.: : 
preferably, the user may design a Smart Object, using methods described below, to'flprSeSt jne-usgr rnav-design : 
particul ar ch aracter . p ; n r u n-: r cm a -c i . 

Preferably, Smart Objects also include sub-objects that define their res ponse to sensitivrty- 0 ^ -j'^ ri ^&jeci? 

30 conditions that may arise externally to the Smart Object itself, such as the pfesence-'-of otHer 1 - ni£ y rj:: ^ c -- ; " 
objects in the computer display. Such sub-objects may specify an interaction or resiibfisfeW*^^"'^ 1 ^^ o*sp;ay. 
Smart Object to another Smart Object, jbi ^example, attraction of one Smart Ob ject 1 having^ rj »^ r '- o"vr,an 
male persona t o another Smart Object having a female persona. Additionally or attentively;* lo an °vner bman f 
sub-objects may specify the response of the Smart Object to other image elements ^ owtf in fhe' : ^- f -^y ute r^pt 

35 computer display, for example, to static or moving graphic icons generated^ oth^igftwafe "RS£i!i ^y&^j 
ap plications , which may or may not include animation and which do not themsclves.Wik^ vr " VAr -Y. r 

Smart Objects. Furthermore, Smart Objects may include sub-objects that have' : leafriiii^ 5 " :: r:V "'^ 
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capabil i ties, as are known in the art, whereby the behavior of the Smart Object is modifie d 
adaptively in r esponse to inputs from the computer-animated environmen t. 

A Smart Object, as described herein, includes data, such as geometrical parameters and 
scripts, which are read by a program that generates an animated image sequence including the 
image element corresponding to the Smart Object. In the context of the present patent 
application and in the claims, such a program is referred to as a Scene Manager. The Scene 
Manager preferably includes program module s that read the data from the Smart Object and 
then, based on the Smart Object's geometrical and behavioral parameters, create a n animated 
mathematical representation of the Smart Object. This re presentation is ren dered to the 
computer display , preferably by means of a rendering module within the Scene manager, using 
3D rendering techniques known in the art. 

In some preferred embodiments of the present invention, the Scene Manager comprises a 
"plug-in" to network browser software. The Scene Manager plug-in is installed and operated" 
by a user of the browser software in a manner similar to other animation plug-ins known in the 
art. In these preferred embodiments, the Scene Manager can receive Smart Objects, preferably 
3D Smart Objects, over the network and then can render images of the Sma rt Objects within or 
overlaid on th e browse r window on the comput er display. 

In other preferred embodiments of the present invention, the Scene Manager comprises 
an application program, which runs in the framework of an operating system, preferably a 
windows-based operating system, as is well known in the art. In these preferred embodiments, 
the Scene Manager operates to create animated images, as described herein, while other, 
generally unrelated applications, such as a word processor program, are simultaneously running 
on the computer. 

In some preferred embodiments of the present invention, a computer animation sequence 
is controlled by scripts, which control the actions of the Smart Objects in the sequence, 
responsive to the attributes defined by the Smart Objects themselves. The scripts are preferably 
e mbedded within the Smart Object s, as describ ed above, but may, alternatively or additionally , 
b elong to the Scene Manager program, which interacts with and contr ols the Smart Objects . 
The scripts preferably comprise motion scripts, which include instructions to modify the position,- 
orientation or other attributes of the Smart Objects over time, from one animation frame to the 
next. Additionally or alternatively, the scripts may comprise connection scripts, which link the 
Smart Objects to input devices, such as a mouse or 3D pointing device, which are then used to 
manipulate the Smart Objects in the display Further additionally or alternatively, the scripts may 
comprise trigger scripts, which are invoked when a predetermined sensitivity condition or event 
occurs, for example, a collision of the Smart Object 1 with another object or selection of the Smart 
Object in the display. 

In some preferred embodiments of the present invention, an object, preferably a 3D 
Smart Object, is used in rendering an image element that is overlaid over a window in the 
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display. For example, a suita ble Smart Object may be used to produce a 3D image of i human 
<: "flguie, which walks across a window created by some other soft ware application, su ch, as an 
I nternet brows er or a word processor program. The window over which the image element is 
overlaid may be an Internet Web page, for example, and may include text or two- or ihree-. 
dimensional graphics, or some combination of text and graphics. The soft^are^applicktfdn 2. r ~r ] "Z~ r ~ """ 
associated with the window preferably continues to operate while the Smart Object *is : runhing: : - - - r: ~- 
Preferably, attributes of the Smart Object and/or a script associated therewith causcThe*"STOrt r::r,: "r^ ~ *'f 
Objectto react to or interact with elements in the window, for example , by reading aloud text" * W^Tf'' Tl 
displayed in the wind ow or pointing to an on-screen pus h-button control. - f/ . • ^c:^: : r 

Preferably, the image element that is overlaid over the window obscures only the portion - 
of jhe window immediately b ehind the element, whil e the remainder of the : window ' is" r ' — 
unobscured, and the application associated with the window continues to function.; ; FdPeach ; v7"^- :r: " 
frame in a computer animation sequence involving the Smart Object, as the image 1 elem^tit"is :orri P :;I - ^n-iauon 
rendered, a transparent mask is concomitantly created, def ining the area of the displa^iHSf £: wilI- ;: ' :; -^" : " er - : — — ^ 
not be obscured by the image element. This mask is used to create a window for the SfnaH ~ " ■"':*' ' 
Object that is exactly shaped to fit a border circumscribing the image element. The shape of this - ^ 
window is adjusted in response to the full 3D motion of the Smart Object, unlike- Sprite - -} i:r - n m wpon? 
overlaying methods known in the art, in which changes in the transparent areas of th5 > spfttiS r al^ Ref -' ?0 '- s "^nov-Ti* in th 
substantially limited to 2D effects. : t: \ tt i^ ^ ^ 

In some preferred embodiments of the present invention, a user interface is provided tO" ; ■ ^ : -j 
enable a user to program and control Smart Objects and computer animation sequenc&TUSmg \W Xxj r ^ iT; 
Smart Objects. The user preferably creates animations by choosing. Smart Objects frdiW^ 1ib&rp> « c userpreien 
and/or by creating Sman Objects from libraries of sub-objects that define attributes u bf : th& :r:yiii:: z ri?1!n i 
appearance and behavior of the Smart Objects, as described above. Further preferably <ihe4iSCT ariJ: zzv&yM o; s.;ic 
inter face enables the user to create scripts and otherwise define animation sequences in^dirig l^ 1 ■ ' e . u l^p 0 £L C 
for example, motion paths, sound and interactions of the Smart Objects with one an6tVerWd/6r ^ ^[iA^P^i^ -^n 
with a viewer. In addition, the user interface preferably allows the user to define cahi&k r ah^js? r \* n ^^fc>P» ^ 1 
and simulated lighting characteristics that are applied in rendering the animation sequences' bn-- ?3^ n § ^character 
the computer display. » computer mspmy. 

In one preferred embodiment of the present invention, the user creates' a Smart Object ne P-"- erred embed n 
which serves as an avatar for the user or for another individual. An image of the v user oFb'f 5 as an avatar for t; 
another individual may preferably be scanned into the computer, as is known in the'artf anfr v:ci — ! — V preibrsb 
overlaid on a surface of the image element corresponding to the Smart Object, prefefabfy tm :i ™ mr * or xr& \m< 
the head of the image element. >"-au *»t. i?te.>*M*vr: cicmcm. 

In some of these preferred embodiments, the user interface enables tRe'user ta.ch6Bs€p nie --°- ^5-- -P r ~— 
and navigate in virtual 3D space among predefined viewpoints. For each viewpoint, 5fi1niig£blP T 1 vinuaj 3D s. ;£ce 
an animation scene is rendered and displayed corresponding to an image of the scene th&t W6t))d rt :'" ,VlV ' u : — ; ' * 
be captured by a camera filming the scene from the location of the viewpoint. At eacli *' : ^ " : 
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viewpoint, the user is able to alter the effective camera angle, up/down and left/right, and to 
zoom in or out. The viewpoints may be stationary, but preferably, paths are defined between 
reference points in the 3D space, along which paths the viewpoints are to move, so that the 
virtual camera position changes accordingly. Additionally or alternatively, a user may indicate a 
reference point in the 3D space and instruct the viewpoint to orbit around the point and/or to 
move toward or away from the point. . These methods for user control of the viewpoint are 
substantially easier for the user to conceptualize and control than are "free navigation" user 
interface tools known in the art, for example, "CosmoPlayer" a commonly-available VRML 2.0 
browser program, described above. 

In some of these preferred embodiments, the user interface includes on-screen graphic 
devices, with which the user interacts, preferably using a mouse or 3D pointing device, known in 
the art, to control the animation. These devices preferably include one or more sliders, push 
buttons, dubbing strips and other elements known in the art. The on-screen user interface 
devices are, preferably, automatically scaled, such that when the user resizes or changes the 
shape of the window on the computer screen in which the animation is displayed, the sizes, 
positions and spacing of the devices are adjusted accordingly. Adjusting the sizes and positions 
of the on-screen devices-allows a maximal portion of the window to be used for displaying the 
animation and enhances the esthetic appeal of the display. The scaling of the user interface 
allows all of the controls to be seen simultaneously on the screen, even when the window is 
substantially reduced in size, unlike user interfaces known in the art, in which some or all of the 
controls disappear from the window under such conditions. 

Among the on-screen devices, the user interface preferably includes a 3D joystick, which 
the user manipulates to navigate in the 3D space. The 3D joystick moves in a plane, thus 
controlling two degrees of freedom. Preferably, the joystick is used to control tilt and pan of a 
virtual camera from whose point of view the scene is rendered, while a slider controls the 
camera's zoom. Alternatively or additionally, the joystick may be used to control revolution of 
the virtual camera about a selected reference point in the scene. 

Preferably, the portion of the window used for displaying the animation is not strictly 
rectangular, but is rather surrounded and framed by non-animated elements, including the user 
interface devices. The devices may penetrate into the edges of the frame containing the animated 
images. The non-rectangular frame is preferably designed to give the animated scene a more 
realistic appearance, as though it were taking place, for example, in an auditorium or a television 
studio. 

In some preferred embodiments of the present invention, an associative visual search 
engine is provided to assist the user in selecting elements to be incorporated in a computer^' 
animation. The engine is used in searching through an image database that may include image 
representations of Smart Objects and sub-objects thereof, as well as other animations, still 
objects and background and border images. One or more keywords, generally a plurality of 

8 



SUBSTITUTE SHEET (RULE 26) 



WO 97/35280 



PCT/IL97/00093 



keywords, are associated with each of the images in the database. The keywords preferably 
describe various aspects of the images, including image subject, content, style, color and other 
attributes. The keywords associated with each image are preferably ordered hierarchically, from 
the keyword that is most descriptive of the image to keywords that are less descriptive thereof. 
5 To use the search engine, a user preferably enters a keyword or selects 1 ™ image from air" 

initial group of images displayed on the computer screen. The engine then searches 1 the^database 0 
for images matching the keyword that was entered or matching a keyword of keywords" 
associated with the selected image. The user may narrow the search by specifying a 
characteristic of the selected image to be matched, such as its subject matter Srcbfoff'fdf 

10 example. Images in the database that are found by the engine to match 11 the keyword or 
keywords are displayed on the computer screen in a hierarchical, preferably generallfy'^Ont^tric : : 
pattern. Preferably, images matching the keyword or keywords most closely, i.e.^rrta^fes with " 
respect to which the keyword or keywords searched for occupy the highest po^itte'nrirtnhe '' 
images' respective hierarchies of associated keywords, are positioned nearest the ^WteY^orth r ^ r1 

15 display and scaled to a relatively large size. Images matching the keyword o> keffitiffii nibre v 
remotely are positioned peripherally. - — 

The user may browse through the images displayed on the screen by pointing to imWg^s^ 
of interest, for example, using a mouse. When the user points to an image, ttte i Wnl^ i i/ 0F 
preferably enlarged and/or expanded. If the image represents a 3D image element;- k is 

20 preferably rendered in three dimensions. If the image represents an animation ~o71immated ~ 
object, for example, a Smart Object, at least a portion of the animation or a movement >ofnhr" : 
object is displayed. The user selects images from the search for inclusion, in £ii-a11inikff6 ; ri^ ;ia ^ 
sequence or, alternatively or additionally, selects an image to serve as the starting -pbinrfor a 
new search. -a,.,, 

25 Ir wil1 be appreciated that the search engine and search method described above allows ijf ~ "w** 

the user to search through an image database in a more intuitive manner than is possible witlF ; " ::: ;;iro 
search engines and methods known in the art, and therefore enables the user to^ftS 2 !iurVabiS es aau m - lii0t ^ mo 
images more. efficiently and quickly. Although the associative visual search enginFd§Scnb& -'"' ^Hiy : 
above is preferably used in generating computer animation sequences, as describ6d^r^ih^in " ;r ^'- v 1,1 ^ CI;C 

30 other preferred embodiments of the present invention, the engine may be used advantageously ' " = 
for searching through image databases of other types and for other purposes. - :;;rcr;:r '^ I'lrou-n m^t, J^; 

In some preferred embodiments of the present invention, after the user has used a s6Urce" : ~' - 
computer to create a computer animation, the animation is encapsulated and conveyed over "a w ^ ut ^ ^'"k u ^ • 

network, preferably the Internet, to a destination computer. In this context, the term" "computer v-.m-l, . 

^ ? 35 animation" means a computer animation sequence, which is preferably created by^'fK^Ws^V ak" c '" : ' ,2> " a ,:ui "P U!er ?:n 
described above, or a Smart Object having attributes of motion. Encapsulating arifr^v^faf' 
the animation comprises sending files associated with the animation over the network, preferably 
in the form of an electronic mail message or other network communication. Preferably, the 
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animation file is encaps ulated as a 3D VRML-com patible anim ation file, as descri bed above, or 
alternativel y, as a JAVA applet or HTML file or in another standard file format recog nized by 
suitable Internet b rowser program s. When the animation is received, it may be replayed as an 
animation sequence on the destination computer display, or incorporated in an animation 
sequence running on the destination computer. 

In some of these preferred embodiments, the animation sent from the source to the 
destination computer comprises an animated "letter," for example, a greeting card, sent by 
electronic mail. The letter preferably includes one or more Smart Objects, which are 
programmed at the source computer to convey a desired message and/or exhibit a desired 
behavior when animated on the destination computer. 

In other preferred embodiments of this type, the animation sent from the source to the 
destination computer comprises an entertainment or educational program, distributed by a 
network server to a plurality of client computers. Each of the clients receives the animation as 
created and sent by the server, but the client user may then control certain aspects of the 
rendering of the animated images on the client computer screen, such as varying the viewpoint, 
lighting and appearance of the characters, for example. Preferably, the clients include both 
viewers, who receive the animation from the source but are allowed relatively little control over 
the animation, and participants, who may actually control a character appearing in the animation. 
Most preferably, each participant controls a respective character by defining the appearance and 
behavior of a Smart Object corresponding to the character. 

In still other preferred embodiments of this type, the animation sent from the source to 
the destination computer comprises a Smart Object, preferably a 3D Smart Object programmed 
as an avatar of the user, as described above. P referably, the ava tar conveys an electronic n^ il 
message to a user at the destination computer. Additionally or alternatively, the avatar may be 



incorporated as a participant in an interactive, animated program on the destinati on computer, " 
for example, as a pa rticipant in a conference , interview or panel discussion conducted over the 
Internet or another network. : 

There is therefore provided, in accordance with a preferred embodiment of the present 
invention, a method for producing, an animation sequence .on a graphic display driven by a 
computer, including: 

defining an object, which includes data including a geometrical description of an 
animated character and characteristics of social behavior of the character; and 

animating an image of the character responsive to the characteristics. 

Preferably, defining the object includes programming a predetermined response of the 
character to a sensitivity condition occurring externally to the object. ° 

Further preferably, programming the predetermined response to the interaction condition 
includes programming a rule governing motion of the object responsive to the condition. 
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Additionally or alternatively, defining the object includes defining* sufficient 
characteristics of the behavior of the character such that the image is animated substantially 
without reference to animation instructions external to the object. 

Preferably, animating the image includes rendering a three-dimensional image of the , 
5 character. r ■ 

There is also provided, in accordance with a preferred embodiment of the present 
invention, a method for producing an animation sequence on a graphic display driven by a 
computer, including: 

defining a group of objects, each such object associated with a respective animated 
10 character and including data, which includes: . » 

a geometrical skeleton common to all the objects in the grouped, characterized by " 
a hierarchy ofsub-objects connected by joints; and - rr c: : v > :^ 

rules governing behavior of the respective character, which rules define motions ■■n. , :t:.s ^ovtrnmg.ci 
of the joints and are interchangeable among any of a plurality of the objects; and :: - ^.---^ ;v;;J ; ;u ir^i, i 
1$ animating an image of at least one of the characters responsive to the rules. ^" : " : ' ' ' 

Preferably, defining the group of objects includes defining a three-dimensional skeleton; 1 L ~ : L - ;: - : :: z " L 
and animating the image includes rendering a three-dimensional image. ■* "•* : :; 1: :: " ^ :^ v n-r.^ 

Additionally or alternatively, defining the group of objects includes defining 4i&&' ojj: ^ v ° ! aiiciijaiiv 
governing behavior of a predetermined personality type, associated with one or .more* of: the 

20 animated characters. — -m-.c^ 

Preferably, defining the group of objects includes defining first and second objects; 1 ^' 1 ; .. •ucmiiny : 
wherein the second object is defined by inheritance from the first object. v s -ncicm m-c icouiju uuject is oe:;n 

There is further provided, in accordance with a preferred embodiment of the present-'"" *:^v--- 
invention, a method for providing a user interface in a computer graphic display, including:' 01 ^ i k;i j.!;i;vi:.iM:i> 

25 displaying one or more user control icons in a window in the display; and v^uiaymv one ur more us* 

scaling the one or more icons responsive to a change of scale of the window. r, ffc ; y: 

There is.also provided, in accordance with a preferred embodiment of the pr&erff- is a,so provsceQ, i 
invention^ a method for producing an animation sequence on a graphic display driven^by L a n ^ :nG0 :cr prooi-c:. 
computer, including: 

30 producing a frame image having a non-rectangular transparent area; - : — •» ; * - - : ; 

generating an animation sequence on the display; and .^-■i-^ an.GinUinuvu ±>c 

overlaying the frame image on the animation sequence, so that the animation is framed by-j^ UIC lii :iUt ■ 
the transparent area. ucilvj^cih 

In accordance with another preferred embodiment of the present invention, there is ::: ' ' 
35 additionally provided a method for producing an animation sequence on a graphic dfs^I4^^vfe'ri 3roviae( l a - l ' nernoa ic; 
by a computer, including: - ■ zoii'-yuvir, inciiianig: 

defining a three-dimensional geometrical description of an animation scene; f " - £ ■ : ' l -' r - '>*'"'" ' 
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selecting first and second reference points relative to the scene and defining a geometrical 
path dependent on the points; 

rendering a first image of the scene as seen from a viewpoint at a first position on the 
geometrical path; 

translating the viewpoint to a second position along the geometrical path; and 

rendering a second image of the scene as seen from the second position. 

There is additionally provided, in accordance with a preferred embodiment of the present 
invention, a method for producing an animated overlay image on a graphic display driven by a 
computer, including: 

generating a three-dimensional animated image element; and 

overlaying the animated image element on a window in the graphic display driven by a 
software application substantially unrelated to the generation of the animated image element. 

Preferably, the substantially unrelated software application continues to run substantially 
as though the image element was not overlaid on the window, and the only portion of the 
window obscured is the portion directly behind the image element on the graphic display. 

There is also provided, in accordance with another preferred embodiment of the present 
invention, a method for conveying an animation from a source computer to a destination 
computer, including: 

defining an object in the source computer, the object including data, which includes a 
graphic description of an element for inclusion in the animation and a characteristic of motion of 
the element; 

transmitting the object from the source computer to -the destination computer via a 
network; and 

displaying an animated image on a display driven by the destination computer, wherein 
the image includes a graphic rendition of the element, moving in accordance with the~ 
characteristic. 

Preferably, transmitting the object via the network includes encapsulating the object arid 
transmitting the encapsulated object in the form of an electronic mail message. 

Alternatively or additionally, a script is transmitted over the network, which script 
defines an animation sequence including the element, and wherein transmitting the object and' 
transmitting the script include transmitting the object and the script to a plurality of destination 
computers. 

In accordance with another preferred embodiment of the present invention, there is 
moreover provided a method for finding a desired image among a library of images stored by , a. 
computer, including: 

displaying a first plurality of images from the library on a display associated with the 
computer; 

selecting a first image from among the first plurality; and 
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searching through the library to find a second plurality of images resembling the first 
image in one or more characteristics thereof. 

Preferably, a cursor is shown on the display and one of the images is altered when the 
cursor points to the one of the images, preferably by animating the image. 
5 There is further provided, in accordance with a preferred embodiment of the present '**"tr--" nHV 

invention, a system for producing an animation sequence, including: - . isrJ..\r 

an animation generator, which generates an animated image of a character, responsive '.f6~ :: '" •■^"•'.v-tLS-- 
an object including a geometrical description of the character and characteristics of social . 
behavior of the character; and nc 
10 a display^ which is driven by the computer to display the animated image. 

In addition, in accordance with another preferred embodiment of the present invention," :r:: " :r - r 
there is provided a system for producing an animation sequence, including: - ^ . ^ for - - ■- - 

an animation generator which generates an animated image of at least one character fr6th !ii ^ tlU!l w^ ii:zr - 1 — 
a group of characters, responsive to a respective one of a group of objects, " r r ^P r -"- characters. : ztp-j^yv^ ■, 

15 wherein the objects include a geometrical skeleton common to all the objects in^the- : ^5""^ ^ • 7 

group, characterized by a hierarchy of sub-objects connected by joints, and rules governing- " 
behavior of the respective characters, which rules define motions of the joints arid ttre iJi:: ^-p"' : * : — 
interchangeable among any of a plurality of the objects; and nitercrtanfj.eable among any of a pi' 

a display, which is driven by the computer to display the animated image. . *. ti .u\ 

20 There is also provided, in accordance with a preferred embodiment of the present ; . 

invention, a.system for producing graphic images, including: — - ; <• i:!-.^^: 

an animation generator, which generates a scalable graphic window with one or^tiM"^*™ &cK=iaiu;\ v.- 
user interface icons contained therein, such that the icons are scaled responsive to a-scale of tht^^ lt 

window; . 

25 a user input device for scaling the window; and - ^ » i*>u.ui a^v-i. io> 

a display, which is driven by the computer to display the window with the icons. - ft ^ispsay, which *s linvc?? r 

There is moreover provided, in accordance with a preferred embodiment of the pttSfctff *s moreover nrnvinr. 
invention, a system for producing an animation sequence, including: iriv^iiii^ z system for producing ; 

an animation generator, which generates an animation sequence and which produ"ced li a :: ^ Iion .B- f;ei ^ !or » v * 
30 frame image having a non-rectangular transparent area, such that the frame image is'overtaittori- 1 ? w:;-;^;icnrr 
the animation sequence, whereby the animation is framed by the transparent area; anti^'* 1 "'"*^^ whereby i. 

a display, which is driven by the computer to display the animation sequence framed-tty-y* wmcn >z onven l 
the transparent area. ^ ■ uiuum ^m ni . 

Additionally, in accordance with another preferred embodiment of the present invefitiorf;-"' * :: * * ; 
35 there is provided a system for producing an animation sequence, including: ,,;r ^- »> ;u ovinia a system ior proe 

an animation generator, which renders animated images of a. three-dimensional $eb^ in ¥^ Gri " iip^ator, \v 
each image rendered as seen from a respective viewpoint, including a first image of the scefie , : " |V " - * ^* 0,; ' 
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seen from a first viewpoint along a predetermined geometrical path and a second image of the 
scene as seen from a second viewpoint along the path; 

a user input device, for selecting first and second reference points, which determine the 
geometrical path; and 

a display, which is driven by the computer to display the animated images. 

There is further provided, in accordance with a preferred embodiment of the present 
invention, a system for producing an animated image, including: 

an animation generator, which generates a three-dimensional animated image element and 
produces a display window driven by a software application substantially unrelated to the 
generation of the animated image element, and which overlays the animated image element on 
the window; and 

a display, which is driven by the computer to display the window with the animated 
image overlaid thereon. 

There is further provided, in accordance with a preferred embodiment of the present 
invention, a system for conveying an animation over a network, including a source animation 
generator, coupled to the network, which defines an animation file comprising an object, which 
includes a graphic description of an image element for inclusion in the animation and a 
characteristic of motion of the element and transmits the object over the network in the form of 
an electronic mail message. 

In accordance with another preferred embodiment of the present invention, there is 
provided a system for conveying an animation over a network, including a network animation 
server, which receives a textual description of an animation object, generates an animation file 
based thereon, and delivers the animation file to a destination computer. 

There is also provided, in accordance with another preferred embodiment of the present 
invention, a system for viewing an animation, including: 

a destination animation generator, coupled to a network, which receives via the network 
a script defining the animation along with an object including a geometrical description of an 
image element for inclusion in the animation and a characteristic of motion of the element, and 
renders animated.images responsive thereto; 

user controls, coupled to the destination animation generator, for controlling rendition of 
the animated images; and 

a display, which is driven by the destination animation generator to display the animated 

images. 

There is additionally provided, in accordance with a preferred embodiment of the present 
invention, a system for searching a library of images, including: 

image storage apparatus, which stores the library of images and selects a first plurality of 
the images to be displayed; 
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a display, which is driven by the image storage apparatus to display the images selected 
by the animation generator ; and : 

a user input device, coupled to the image storage apparatus, for pointing to and selecting 
a first image from among the first plurality of the images displayed, ~ . : ~" ' 

wherein the animation generator searches through the library and selects images--- <t5ir - r " 
resembling the first image in one or more characteristics thereof, for inclusion : in : a~*sec6nd v " " 
plurality of images. y\^y <v ?rr;?g?:. 

The present invention will be more fully understood from the following detailed ~" 
description of the preferred embodiments thereof, taken together with the drawings in whicH: : ■ — — - 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic representation of a computer system for use in producing and r - " 
displaying animation sequences, in accordance with a preferred embodiment of'the^pKserif'"- 1 -":^ 7 * 
invention; iuventicr ; 

Fig. 2 is a graphic representation of a computer image element generated on a compter - 2 r "; :? 
display screen by a Scene Manager responsive to a 3D Smart Object, in accordiH<& a wftfr ^ *y £ ^ 
preferred embodiment of the present invention; preferred embodiment c 

Figs. 3A and 3B are graphic representations of the computer image elements g£nefSt&i 3 ^ and 55 
on the computer display screen by Smart Objects, illustrating animation of the -elements 7 iriP-tcr dispir 
response to one another, in accordance with a preferred embodiment of the present irivenWnV n °" r,ft ? " 01 — 

Fig. 4 is a block diagram illustrating the program structure of a 3D 'Smart ObjeSi?ih 4 bior: 
accordance with a preferred embodiment of the present invention; .accoi^r.vce with -a brefe 

Fig. 5 is a flow chart illustrating a method of generating a computer animation seqi&fce 5 is a flow " 
including the 3D Smart Object of Fig. 4, in accordance with a preferred embod^inPWiKe — 
present invention; present invent:-- 

Figs. 6A and 6B are graphic representations of an image elemerft^generated *or£% ^ ar,, j ^ 
computer display screen by a 3D Smart Object, wherein the image element is ovgfrald^h'-^P 1 ^' "s*cre>; 
display window generated by another software application, in accordance with^rp^Feiff^ 0;V cfiiitrz 
embodiment of the present invention; ~ enftodirnsrit of ffe ^rr- 

; Fig : 7 is a flow chart- illustrating a method of overlaying the image element on the dispfay 7 z-0~s.~ 
window of Figs. 6A and 6B, in accordance with a preferred embodiment, of 'tHe^pfesSm^^ 3 6A a 
invention; inv.-ntinr; 

Fig. 8 is a graphic representation of a computer display screen illustrating elements F 6 f f a* !S z ? r2DP - 
graphic user interface presented in a window on the screen, in accordance with^ a p'f#efraf interface w. 
embodiment of the present invention; 

Figs. 9A and 9B are graphic representations of the computer displa^ Screen of Fig!£8, 
showing changes in the shapes and sizes of elements of the graphic user interface as^Ke'siii and r C' 
shape of the window are varied, in accordance with a preferred embodiment of^Ke^reserit' 
invention; • ? - ~ L.;, 
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Figs. 1 OA and TOB are schematic illustrations of a computer animation scene, useful in 
understanding the operation of virtual cameras for rendering computer animation sequences from 
different viewpoints, in accordance with a preferred embodiment of the present invention; 

Figs. 1 1 A and 1 IB are graphic representations of the computer display screen of Fig. 8, 
showing changes in rendering of the scene responsive to selection and movement of the virtual 
cameras of Figs. 10A and 10B, in accordance with a preferred embodiment of the present 
invention; 

Fig. 12 is a graphic representation of a 3D joystick, shown on the computer display 
screen of Fig. 8, for use in controlling the operation of the virtual cameras of Figs. 10A and 10B; 

Figs. 13A and 13B are graphic representation of a computer display screen, illustrating a 
graphic user interface used in conjunction with an associative visual search engine, in accordance 
with a preferred embodiment of the present invention; 

Fig. 14 is a flow chart illustrating the operation of the visual search engine whose user 
interface is shown in Figs. 13A and 13B, in accordance with a preferred embodiment of the 
present invention; 

Fig. 15 is a block diagram illustrating a system architecture for transmission of a 
computer animation program over a computer network, in accordance with a preferred 
embodiment of the present invention; 

Fig. 16 is a block diagram illustrating a system architecture for transmission of an 
animated message over a computer network, in accordance with another preferred embodiment 
of the present invention; 

Fig. 17A is a graphic representation of a computer display screen illustrating the 
preparation of an animated message, in accordance with a preferred embodiment of the present 
invention; 

Fig. 17B is a flow chart illustrating a method for preparation of the animated message of 
Fig. 17 A, in accordance with a preferred embodiment of the present invention; 

Fig. 18A is a graphic representation of a computer display screen illustrating playback of 
the animated message of Fig. 17A by a recipient thereof, in accordance with a preferred 
embodiment of the present invention;, and ^ . , . - 

Fig. 18B is a flow chart illustrating a method for playback of the animated message of 
Fig. 18 A, in accordance with a preferred embodiment of the present invention. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Reference is now made to Fig. 1, which is a schematic representation of an animation 
generator, preferably a computer system 40, for use in producing and displaying computer 
animation sequences, in accordance with a preferred embodiment of the present invention. 
5 Computer 40 comprises a console 42, including a processor 44 and memory 46, "preferably 

comprising both RAM and disk memory, as are known in the art. The computer also includes * : " " " ::: 

user input devices, such as a keyboard 48 and pointing device 50, for example, a mouse. 

Computer 40 includes image rendering software, such as RenderWare, described above, 
. which enables processor 44 to produce animated computer graphic images 5 1 , which are seen on 
10 a display 52. Animated images 5 1 are preferably produced in response to an animation program, 1 - 1 ~ : - 

run by processor 44, preferably a Scene Manager program, which generates images based on 3D 
Smart Objects, as described herein. Preferably, the images are accompanied by sound;" which is v 
produced by an audio device 56, such as a speaker, coupled to the processor. proquceo oy an ?uutu u^v x :>o, : 

Computer 40 is preferably coupled via a modem 54 to a computer network 60, preferably^"- J ,:> [ ^ "^or 
15 the Internet, and sends and receives animation files over the network, as described below. ' ' " " : 

Further preferably, the computer includes browser software, for example, a VRMIi-cdiTipaiiBfe 65 " 50 ' ^ 
browser, suitable for viewing animations conveyed over the network. Ui - 1 - u .- sui ; ?.dj5 :zr v;cv.".r,ti 

Fig. 2 is a graphic representation of display 52, showing an animated image produc^% 2 r< Li"*:"" 1 " pre- 
processor 44 based on a 3D Smart Object, representing a young female character 64r : The" ct -'\ 
20 animated character, rendered as a 3D image, is seen to walk out on screen and take a pbsitiohHh Mdu - ;-r^ 7 :: ?;s - 
J front of an application window 6 6. The application that drives window 66 is generaUy; unrel^tMP^ iCL;:on ^noow . ck 

to the Scene Manager anim ation program and to the Smart O bject, and the applicati6ti fcohflfiras manager am-rnanon r 

— " — * " ~ * f — "* ■ 

t o run substantially uninterrupted by the animate d .image. Character 64 obscures dnly^ the ; iir;.nK^,-up^ 

portion of window 66 that the character directly covers, while the rest of the windbW ! fghiSins ViilGOVV °° rn?; l!iC - C: 
25 normally active and visible, as though character 64 were absent. The software stnfcfin^afiff'^ - £l ^ vis-.b.z. &s \>. 
methods used in producing the animation and overlaying the character on the wihdow" areP i[] V'*oauwr& \r.t- 
described below. described beiow. 

... . As described- above, the term "Smart Object H as used herein, in accordance ^ttf 050 ^^ -^ove, xY,z 
preferred embodiments of the pr^ent invention, refers to an object, or module, xonlpfis'ifi^ 
30 the graphic/mathematical description of an image element and embedded andllaryMnforrriat^ cescnp 
about the element. Such ancillary information preferably comprises procedures, wHiar- l deKfiBfe c,,tc,,i - ' > ' ^t:r, "afciiian 
attributes, motion and behavior of the element, as described hereinbelow, and may i also u iricltid I e :uuc;n savior o. 
textual reference data. These procedures are preferably in the form of scripts, i r e^iistk e of " ence GiM2 -. > ness P 
instructions that are read and executed by the Scene Manager "3D Smart Objects-'-preferaWy""" 11 f " 1 " L " ' ,? ' OAr 
35 include attributes of shape and motion that are used in rendering 3D images ofthe cdfresi^fiiaiHg U!JU ' s c ' : ™« 
image elements.. Vi Tk z H^ ^ernenii. 

Figs. 3A and 3B are graphic representations of display 52, showing animated imams' : " "~ : 1 ^ " r: ~ 
produced by processor 44, which illustrate further aspects of the behavior of 3D Smart Objects. 

17 



SUBSTITUTE SHEET (RULE 26) 



SI 



WO 97/35280 



PCT/IL97/00093 



In Fig; 3 A; young female character 64 has walked out onto the screen, while a male character 68 
stands at the opposite side. The Smart Object corresponding to male character 68 includes 
animation scripts that define the character's behavior in response to young female characters. 
These scripts are triggered by the presence of female character 64 within a predetermined region 
of proximity to male character 68. For character 68, the region of proximity is determined to be 
the entire area of display 52. 

As shown in Fig. 3B, in response to the proximity of female character 64, the scripts that 
are triggered cause male character 68 first to look at the female character and then to jump 
excitedly. The scripts that determine these behaviors are contained entirely within the Smart 
Object, so that - the response of male character 68 to female character 64 is generated 
substantially autonomously by the Smart Object. There is no need for a script or program 
external to the Smart Object to create the behavior, although it is possible to manipulate Smart 
Objects using such external scripts. 

Furthermore, although character 68 exhibits, in this case, behavior that would be 
characteristic of a young male, the behavior may be transferred in a modular fashion from one 
Smart Object to another, independent of their physical appearance and other characteristics. 
Thus, for example, any or all of the behavioral routines that make up the young, male 
"personality" assumed by character 68 may be transferred to another character having the 
appearance of an old man or woman, or of a robot. It is sufficient to transfer the specific 
routines that are triggered by the proximity of female character 64 to cause the other character 
to look at the female character and jump excitedly. Unlike animation programs known in the art, 
no other reprogramming or adjustment of the animation of the other character is generally 
needed. 

3D SMART OBJECTS 

Fig. 4 is a block diagram illustrating the data structure of a 3D Smart Object 70, in 
accordance with a preferred embodiment of the present invention. The hierarchical structure of 
Smart Object 70 is what makes possible the autonomy and modularity of Smart Objects, as 
described above with reference to Figs. 3 A and 3B. 

^Smart Object 70 comprises a skeleton, including surfaces 76, a hierarchy of organs 78 
and behaviors 74 .^Organs 78 are made up of sub-organs 90, which are in turn made up of 3-D 
objects 86, comprising 3D geometrical shapes connected by joints, as are known in the art. The 
term "organ," as used herein, refers to a coherent group of 3D objects 86 that form a part of the 
physical representation of the Smart Object. Surfaces 76 and surface details 94, as described 
below, relate to corresponding 3D objects 86 and define these objects* surface appearance when 
the Smart Object is rendered to display 52 While the skeleton of Smart Object 70 is common to 
all Smart Objects of a given class, for example, humanoid Smart Objects, each Smart Object in 
the class has its own specific geometry 72, defined by the set of 3D objects 86 and surface details 
94 belonging to the Smart Object. 
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Behaviors 74 include 3D animations 88 of the Smart Object, defining motions of organs 
78 and sub-organs 90 at joints thereof The behaviors may also operate on surfaces 76, for 
example, by changing the color of a selected surface under certain predefined circumstances- 
Animations 88 are preferably grouped as mandatory animations 80, conditional animations 82 
5 and optional animations 84. The meanings of these groupings are discussed below^Pr^tefably/' l ' v : 

behaviors 74 belonging to a given Smart Object are chosen and programmed so that the Smart * ~ ^ z ■ 
Object exhibits a desired personality, such as the "young male" personality of character 68 (Figs. * "' " " r ' ' "' ' 
3A and 3B). In the context of the present patent application and in the claims, the term 
"personality" used in reference to a Smart Object or an animated character associated therewith 

o 

10 refers to a set of behaviors that cause the character to move and otherwise exhibit reactions and 

expressions in a manner that is reminiscent of the behavior of a real character, typicallyTfiunian^ ~" 
being, of a certain type. " 'v^'-.t.;; — r« .-/pr-T^r: 

Although the hierarchies of geometry 72 and behaviors 74 are separate, there"is : *a iu ^ i,: n c ™fc'"fcrcn;s? 
complete correspondence between the set of 3D animations 88 and the set of 3D object 86: 4ri ; c: - :: :: 

15 other words, each animation 88 comprises a mathematical description that dictates operations to : * r : 

be performed in a predetermined way on certain objects 86 in the geometrical hierarchy. Each :uju: „. .r.:r.cc 

animation 88 operates on certain organs 78 and sub-organs 90 and the joints connecting them! r ? r\\7Tr.m 
The same hierarchies of geometry and behavior are used for all Smart Objects T 6P^ an,e i""^'*^* <> r 
certain type, for example, humanoid. characters or four-legged creatures, or inanimate (but ^ — 

20 possibly animated) objects, such as.tables or chairs. Therefore, 3D objects 86 and 3D animations" " — — — * 
88 may be exchanged freely, in modular fashion, among all Smart Objects of the type; i:e^S , marf : - i: ""H' J4i "--y* fT 
Objects derived from the same skeleton, whether at the level of individual objects antf ahiirati6H3' cu liUUl uro * rmiu 
or at the levels of organs 78 or groups of animations 80, 82 and 84. By transferring 1 such groups - ' " ' " ^ !! - ' - ~ 
of animations, the personality of a Smart Object corresponding to a humanoid character hiifW^ i — ^-^-y <y* 

25 transferred to or inherited by another Smart Object. Similar conventions apply to surfaces' 76^ Ul li!5{t;rii ^' uy anc 
and to sub-organs 90, as described below. : * : • ^ ?vl'0*i SO, ^ Wlbs 

The hierarchical structure of Smart Object 70 is constructed using 3D animation M fi^i lier?rc t^ - 
tools known in the art, for example, LightWave 5.0 software, as described abo^8 0,: ThS°fbri m af ^ * or ex ^ r 
modularity of the behavior of Smart Objects, however, is not achieved by animation 1 'bbj'eds' and u ~ li ' dV 'or or 

30 systems known in the art, and files corresponding to Smart Objects that are created 'initially'" 11 :iJ UiC - ^ sn a x - 
using LightWave, for example, must be converted to Smart Object form. Smart Ob]^ts b HaV^^^' t sUi eXrt ''fp^ " J 
the features of an object-oriented programming system. They enable animated charaaers toiSe 0 ' <z:: ^s--o:ic;;;cu 
created by transfer of physical and/or behavioral characteristics between different Shikrt 1 Objects ^piiysicai an. 
or between a Smart Object and a library of such characteristics, while leaving the hierarchy 1 -*-;--^ ^ 

35 intact. New Smart Objects and classes of Smart Objects may be created by"inheritante from " n - aa ; <"~s 

existing Smart Objects, including multiple inheritance, as is known generally SS^^s^bif^ ^^O^ls, i.-cludin 
conventional object-oriented programming. 1 o*! r-/- : 0£ 
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Grouping of 3D objects 86 into organs 78 and sub-organs 90 serves the purpose "of 
enabling objects to be exchanged among Smart Objects in such a way that an appearance of 
natural motion of the animated image element corresponding to the Smart Object is preserved, 
and that suitable proportions are maintained between closely-related 3D objects 86 and groups 
of such objects. It will be understood that sub-organs 90 are themselves treated as organs, and 
furthermore, that a sub-organ may contain other sub-organs, below it in the hierarchy. Thus, for 
example, the hands of a humanoid skeleton are defined as one sub-organ, so that both hands are 
exchanged as a single unit. The basic hierarchy of organs 78 and sub-organs 90 and 3D objects 
86 in skeleton 70 of a humanoid Smart Object is preferably defined by the following file 
structure, wherein the term "name" in each case refers to the reference name of a Smart Object 
character with which the organ, sub-organ or object is associated: 



basenull 



15 



20 



25 



30 



35 



cameranull 
narneabdomen 

namebody 

name an back 



namehandlt_0 1 _upperarm 

name_handjt_02_lowerarm 

name_handjt_03_palm 

name_hand_lt_04_fingers 
name_harid_lt_05_thumb 
namehandrtO 1 _upperarm 

name_hand_rt_02Jowerarm 

name_hand_rt_03_palm 

name_hand_rt_04_fingers 
namehandrtOSthumb 

name^neck 

namehead 

nameanhead 

nameanmustache 

namebrowlt 

name_brow_rt 

nameeyejt 

^ame_eye_rt 

nameeyelidjt 

name_eye!id_rt 

name mouth 



vne arrns. V 

b JJpi'EW'.iOn c. 

.j z> . uscq 0? recti y 
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name_ponytail_01 

name_ponytail_02 

name_ponytail_03 

name_leg_lt_0 1 _thigh 

name_leg_lt_02_shin 

namejegjt_03_shoefront 

name_leg_lt_04_shoeback 

nameJegrtO 1 thigh 

namejeg_rt_02_shin 

namejeg_rt_03_shoefront 

name_leg_rt_04_shoeback 

namejailOl 

name_tail_02 

name_tail_03 

The above hierarchy of organs 78 and sub-organs 90 is largely self-explanatory,' but H " ::vc ~> ^rc: : y or 
includes a number of unique features. The abbreviation "an" in certain of the above organs, W^- 3rc ^ 
example, "name_an_head," refers to an "accessory null," for attaching an external^aScekso^ 
such as a hat, in the case of name_an_head, to the associated organ. The expression"' ^ » ! <-= 
"cameranull" refers to an optional connection point for attaching a "virtual camera" to'the SrrVdrt "~ ! - - - ■ - — 
Object, so that an image of an animation scene is rendered as. seen from the point ofView^of^hS^ 1 s» smsgc or an a\ 
Smart Object. The expression "basenull" refers to a dummy joint, at which one Smarf KMyeEF 1 ne expression 
may be connected to another if desired. ! : : ' f it .in^\^a ic ancrrrer i: a 

Surfaces 76 comprise mathematical descriptions of the external appearance of organs' 78," Ci: " ' ° comprise rna 
sub-organs 90 and 3D objects 86. A surface can include geometrical items belongiriglcPsevgftF' 0 ana oojects s*. 
organs. For example, a shirt surface includes geometrical data belonging both to the^dyarS^b 2 -^^;^^ £ shirt sun. 
the arms. When the image of Smart Object 70 is rendered to computer screen 52 t f {he J 8BP6ce3^ en r v e ^-8 e °f £ 
are mapped onto the JD-objects by suitable rendering software, such as RenderWafe;-cf^cW^ crro 3D-ooj-^cis 
above, so that each 3D object 86 is shown on the screen with a surface appearance : 3ttgpmft& ai eacn su - opjecr & 
by the corresponding sub-surfaces and surface details. Ju ^.V llVc corresponomg suu-surraa 

Like 3D objects 86, surfaces 76 and surface details 94 may be exchanged and inherited ^ } ^biecis .bo, -sun- 
freely among Smart Objects of the same type. The term "inherit" is used in the present patent^ - :7 ^ 'Usjccis or ; 
application and in the claims in the sense of the term that is known in the art of objeSr^bri^ScP™ in Ine c! - : - £ ;n : 
programming, to mean that 3D objects and surfaces may be taken from one Smart'Obj'efcrdridS- '° : : " ; -■ lJ 
used directly in creating a new Smart Object without additional adaptation, ^matrons SS^rr' :n — --s - - cv -' - 
similarJy be exchanged and inherited, as described below. Preferably, surfaces 76 of ^HtM^hb1cF xc '^ n S^ ^r.hr.r; 
Smart Object include; S.. rri Ohjer:- io^ude; 

t. ... 
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name skin 

name body top (generally the shirt) 

name body bottom (generally skirt or pants) 

name hair 

name eyes (iris) 

name shoes 

name lips 

Surface details 94 are defined so as to enable the user to edit the colors, shapes, textures 
and other surface features that are mapped onto 3D objects 86 when the Smart Object is 
rendered to display screen 52. For example, surface details 94 of a humanoid Smart Object 
preferably include: " 

name eyes pupils 
name skin face 
name skin face nose 
name skin face ears 

and so forth. Surface details 94 may further include a logo, for example, text or an insignia, to 
be displayed on the shirt of a character rendered on screen 52 

Every Srnart Object 70 includes a set of mandatory animations 80 that define the basic 
behaviors of the animated character associated with the Smart Object: Preferably, mandatory 
animations 80 for a humanoid skeleton include the following motions: 

1. Appear. 

2. Disappear. 

3. Advance (three variations - fast, slow and "slow motion"). 

4. Idle (3 variations)- ~ 

5. Talk. . 

6. Positive. 

7. Negative. 

8. Greeting (2 variations). * 

9. Don't know (perplexity or uncertainty). 

10. Yes. 

11. No. 

12. Special. 
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Each of mandatory animations 80 comprises a mathematical description of motion of the *-*■*.-. 
Smart Object corresponding to a predetermined type of behavior, generally indicated by the 
name of the animation. "Idle" refers to behavior assumed by an animated character associated 
with Smart Object 70 when the Smart Object has not been selected or activated to modify its . 
5 position, orientation or other attributes for a predetermined period of time. 5 Idle^bfehavior-of ' " 
character 68 (Figs. 3A and 3B) could include, for example, crossing his arms and tapping his " 
foot if female character 64 does not appear. Each Smart Object also includes a "Special" ~ 
animation, specific to its character type. Preferably, Smart Object 70 also includes optional 
animations 84. The optional animations can include variations on mandatory animations,* for 

10 example, walking in a way that a viewer of the animation would associate with "cool** of "sexy-- ' :2 *■ — 
behavior, in addition to the three mandatory "advance" animations. Additionally or alternatively, 7 - : * ■ 
optional animations 84 can include animations specific to a certain type of Smart Object: - -For r -- :' 
example, a soccer player Smart Object can have a "kicking" animation. Preferably, Sma7t5©bjetH ; --- ; ' 'p'tnvcs ^i^n -U 
70 also includes a set of conditional animations 82, which define the response 6fMhe-Smart ,: ; ^ conou- 

15 Object to "sensitivity conditions." i.e., events or interactions that trigger the Animations: -Such- --v.:y .:!";".-,.. 
events and conditions may include, for example, proximity to or collision with another object-'—-^ ^ ^ ^c;; 
(which may or may not be a Smart Object) or selection of the Smart Object by a : user. - The- "r-:y - - :y l( 
conditional animations preferably comprise scripts, which call for predetenriined -marid^ yr-zvzcr 
and/or optional animations in response to sensitivity conditions. It will thus be understood;that 1(?i 

20 the reaction of young male character 68 to female character 64, shown in Fig-3B > «-is-controlled j ' vwumv ■ 

by an appropriate conditional animation within the Smart Object associated with mti&tharacft&^z cnnnnroiwi 
68, responsive to the proximity of the female character thereto. As a further example, "s&B^i&We ro me proximity o 
of character 68, by pointing to the character and/or clicking on the character usiftg ffiduse-50'-- ?y ou;; ;;;;^ ;o 
(Fig. 1), preferably triggers a conditional animation that causes the character to turn to itee^rfe^^y inpp&rs cc 

25 user or, alternatively or additionally, to change color, smile, wave or exhibit'^any desired rnauveiy or ^66\\\r 
behavior. u^;uv:c . 

It will be understood that conditional animations 82 are as much a part of Smart dbje<# l - r^.-^rstooc" thrt 
70 as are the features of the Smart Object's geometry 72. Taken together with^mandatory- inures <>f the Si 
animations 80 and optional animations 84, the conditional animations define rules' aPl^ehavior^ <~^ J opinion mm;:- 

30 that impart to the Smart Object a substantially autonomous "personality." Although- theSmarP ^ .wian u.v.?.ci : 
Object may be animated using a program, such as a script, that is external to the Smart-OBject 1 ,^' animateo using -a t 
no such external script is required to engender the autonomous motion and response animation 1 nai ^-npi is requires 
of the Smart Object. When an external script is used, it is generally sufficient thlit **fe script w r.en ar, 

include lines for the Smart Object characters to speak, positions that they are to assume-in'a 1 

35 scene, and calls to animations 80 and 84 that the Smart Objects are to undertake. ;;n: cans to a:ouu;:ions o;; 

As described above, all 3D animations 88 defining behavior 74 of Smart Objects'W r a 0=cri; ^- ; £bc"f, ^ 5 
cgrtain type, such as humanoid characters, correspond strictly to the skeleton of organs' 78 and : " ' 
sub-organs 90 belonging to the type. As long as the skeleton is unchanged, each animation -88 
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operates on specific organs 78, sub-organs 90 and 3D objects 86, irrespective of their shapes and 
sizes. In consequence, the behaviors of Smart Objects are entirely modular, just as the elements 
of their geometry and physical appearance are. Smart Object behaviors are themselves objects 
that may be exchanged and inherited freely between characters, without the need for 
reprogramming when the behaviors are changed or exchanged. 

Fig. 5 is a flow chart illustrating a method for animating one or more Smart Objects 70 in 
an animation scene, based on autonomous behavior 74 of the Smart Object, in accordance with a 
preferred embodiment of the present invention. As described above, the method makes use of a 
"Scene Manager" program to coordinate the actions of Smart Object 70 and other objects in the 
scene. The Scene Manager reads geometrical data 72 and animations 88 from each Smart 
Object 70, and uses them as input data for an executable program module, controlled by the 
Scene Manager, including a moving geometrical representation of the Smart Object. Preferably, 
the Scene Manager maintains a table indicating the status of all the Smart Objects in the scene, 
including their positions and sensitivities, i.e., conditions and events capable of triggering 
conditional animations 82 belonging to each of the Smart Objects. Further preferably, the Scene ~ 
Manager also includes image rendering routines, for example, executable code belonging to 
RenderWare, as described above, for rendering an image based on the geometrical representation 
of the Smart Object to display 52. 

The Scene Manager preferably runs as a plug-in software module together with network 
browsing software known in the an, such as Netscape "Navigator," version 3.0 or higher, or " 
Microsoft "Internet Explorer," version 3.0 or higher. Alternatively or additionally, the "Scene 
Manager can run as a stand-alone application, preferably in a windows-based operating system, 



Tf/L. 



the Smart Oblc 



most preferably a Microsoft "Win32"-type operating system, as is known in the art 

As shown in Fig. 5, after initial animations have been selected for each Smart Object in 
an animation scene, each cycle of the method begins with a "tick," or incremental advance, of a 25 
system clock that drives the animation scene. Each Smart Object in the scene is indicated by an 
index I. At each tick, the Scene Manager reads the selected animation from each of the Smart 
Objects in sequence, either the initially-selected animation or another animation selected later, as 
described below. The Scene Manager activates the program module corresponding to the Smart 
Object to perform the selected animation. The animation causes the program module to alter the ^ 
status of the geometrical representation of the Smart Object, for example, its position, 
orientation, expression or other aspects of its physical appearance. The program module, in 
turn, sends a message back to the Scene Manager indicating its new status, and updating the 
table of Smart Object status accordingly. This process continues until all of the Smart Objects in 
the scene have been activated The Scene Manager then renders an image of the Smart Objects, 35 
based on the new status of the geometrical representations. 

After all of the Smart Objects have been activated, the Scene Manager checks the 
updated status table of the Smart Objects in the animation scene, to determine whether any 
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• sensitivity conditions -have been created. Preferably, the Scene Manager also checks whether a 
user has provided any input that would have an impact on any of the Smart Objects, for example, 
selecting one of the Smart Objects using pointing device 50 (Fig. 1). If no new sensitivity 
condition has been created and no user input has been provided, the system clock is advanced, 
5 and the cycle repeats. ■-. ^ - n---- 

If the Scene Manager detects that a new sensitivity condition has been created for any of ' 
the Smart Objects, however, the Scene Manager informs the Smart Object of the change'and v 
triggers the appropriate conditional animation of the Smart Object. The clock is then advanced, 
and the cycle repeats. Thus, referring again to the example shown in Fig. 3B, when the Scene 

10 Manager detects that female character 64 has moved into sufficient proximity to male character 
68, the Scene Manager triggers an appropriate "excited" animation of the male character. 'The' 
subsequent behavior of the male character is controlled by the Smart Object itself, until the : ' - - 
Scene Manager detects a significant change in the position of the female character or until' some^* ; 
new sensitivity condition arises. =""'■ ^-r.v.-V:-.-.-^- cro.-vJiiic.-.; aii^?. 

15 The method illustrated by Fig. 5 is simplified for the sake of clarity of explanation. Iiwill 'i 1 ^ - :; : -• 

be appreciated that the Scene Manager may fulfill other functions besides those described above: 
For example, as described above, the Scene Manager may apply an external animation script ^ ° ( :'' : ^ s : "" :jv:: 
the Smart Object. Similarly, other animation and rendering programs may be used tc^imate^ :c: l - : : ' c - 
Smart Objects. It will also be appreciated that the method described above may be applied to a 

20 single Smart Object; as well as to a plurality of interacting Smart Objects. - - - — 

TRANSPARENT 3D GRAPHIC OVERLAYS TP>"w<" 
Referring back to Fig. 2, it is observed that 3D character 64 is overlaid on applicStf69T ri,ls back t0 Fi - 2 - 
window 66, while covering only that part of the window that is directly behind^fife :r cKi^dter. v " !i)c ^ * 
Character 64 appears to cast a shadow 98 on window 66, but the shadow is prefefablpaVlfals? appears \o caM a si* 
2 5 partly transparent, and the window text 1 00 is seen through the shadow. 2 : 

Character 64 is superimposed on window 66 using a method referred to hereto W c;c: 
"Transparent 3D. M Although transparent image overlays, commonly called sprites, aV^ r kttg^h £ ?#"* 3D - 
the art, they are generally limited to images produced by 2D rendering and allow oni^D^^ 
of the characters or objects in the images. A sense of depth is achieved only when 2$ $m^W e:r; ~ r — r 
30 overlaid one upon another. By contrast, transparent 3D image element 64 in Fig. 2 iS Ydllf thrfee^ up0Vl uriGln ^ 

dimensional in its rendering, as well as in the range of animated motions that it can ffridMaiffiV^ r! " £ renV ^ erin - ns v - 
described below. cesenbeci be.:ov . 

Figs. 6A and 6B are graphic representations of computer screen 52, further exempliifyttfg 0A ar,d 68 are P^pi i 
the principles of Transparent 3D graphic overlays, in accordance with a preferred eritt&dift^ 3D 6 

35 the present invention. In these figures, a 3D Smart Object corresponding to J i circtfi^^ lhesc r 'i 

110 is used to generate a Transparent 3D overlay image of the airplane, oveMiid 1 orT^ 
application window 1 12, for example, an Internet Web page. Airplane 1 10 circles contiriuously 
above window 112 along a 3D path indicated by arrows 1 16: It will be observed that as the 



""J " m ' " ■ t\J 1 i . _ vt ; ; \j \ 
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airplane "flies" from its position 'in FigrffA'Yo that in Fig. 6B, the shape of the airplane, as 
reflected by a border 1 14 circumscribing the airplane, changes responsive to the changing angle 
and perspective distance from which the airplane is seen. Yet the only part of text 100 in 
window 112 that is obscured is that which is directly behind the image of airplane 110, as 
defined by border 1 14. 

Fig. 7 is a flow chart illustrating a method for creating Transparent 3D image overlays, in 
accordance with a preferred embodiment of the present invention. The method is based on the 
use of irregular-shaped, i.e., non-rectangular, windows on computer display screen 52, 
particularly as defined and supported by Microsoft Win32-type operating systems, such as 
Windows 95 and Windows NT 4.0. The method is also applicable, however, to computer 
animation systems using other operating systems that support irregular-shaped windows. 

To create a Transparent 3D overlay, a 3D object is chosen, preferably a 3D Smart 
Object, such as that corresponding to airplane 1 10 in Figs. 6 A and 6B, as described above. The 
behavior, particularly the motion, of the object is determined, and a suitable 3D view, generally 
comprising a viewpoint and view angle, are chosen for rendering the object. A 3D rendering 
engine, for example, the rendering module of the Scene Manager, preferably using RenderWare 
software, as described above, renders an image of the object to an off-screen bitmap. Within this 
bitmap, the rendering engine or another software module identifies which pixels have been 
written to, i.e., which pixels are occupied by the image of the object, and which have not. This 
information is used to create a mask exactly covering the pixels that were written to, so as to 
delineate a border 114 of the image and a transparent area outside the border. The mask, 
surrounded by border 1 14, thus defines a window shape that exactly fits the image of the 3D 
object. - ' 

This window definition is passed to the operating system running on processor 44, and is 
used by the operating system to shape a window for the object that exactly fits border 1 14, 
making use of a capability of Win32 and other, similar operating systems of creating irregular- 
shaped windows. The operating system thus draws a window on screen 52 that contains the 
image, for example, the image of airplane 1 10. This window is overlaid above other windows on 
the screen, such as application window 112. Since the window containing airplane 1 10 exactly 
fits the shape of border 114, the remainder of application window 112 is substantially 
unobscured. 

The shape and position of the window containing the image of the 3D object remain 
unchanged for as long as the object's behavior and position and the 3D view for rendering the 
image of. the object do not change In . general, however, Transparent 3D image overlays 
comprise animated images, which do change, substantially continuously. Thus, as shown in Fig. 
7, the Scene Manager checks regularly to determine whether the 3D view or the object's 
behavior has changed. For example, a sensitivity condition may have triggered a change in the 
behavior of a Smart Object, as described above with reference to Fig. 5. In such a case, a new 
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3D view and/or new object behavior is determined, and the process of drawing a suitably-shaped 
window for the new image of the 3D object is repeated. Similarly, if the 3D view and object _ 
behavior are unchanged, but the animated object is in motion, as shown, for example] in Figs." 6 A ' 
and 6B, then the window containing the image of the object must be continually redrawn -in- 
5 either case, a new image of the object is rendered to the off-screen bitmaps ovenvh¥ng a tfie £ : «- vv i of 
previous bitmap, and the new bitmap is used in re-shaping the object window, as" described" ^- 1 - ■•- 
above. -~v- 

Whenever the shape and/or position of the object window changes, a different portion of 
application window 1 12 will be exposed. This newly-exposed portion of display 52 is quickly * * - 

10 redrawn, ia.accordance with the application driving window 1 12. Throughout the process of 

drawing and displaying the Transparent 3D overlay image of airplane 110, the application 't>f ** "V "'2 :% 
window 1 12 continues to run substantially uninterrupted. " r -~Zz \v l :\1 i; .. r..-...:-.r. . .. 

Although sprite overlays are known in the art, as described above, none has been cap'alH6 o:j ^ IV ' s P riI ' e overlays", 
of 3D image overlays with real-time animation, and none has combined 3D image rendering r witlr ^v.n^y.N win; ^-.ai-i; 

15 Win32-rype irregular-shaped windows. Transparent 3D objects allow complete freedbrrrftf : 
animation, based on manipulation of geometrical models, including arbitrary charigel~ih~the :::: - c /..>.:.:;-.:.;.-.;; 
objects' motion, behavior and rendering. Animated image overlays known in the aft use only h - *- : "~ : " r r * 
pre-programmed animations, allowing very limited Variations in the appearance ofKhe"bv¥HEy f;nu ^ animations, nllx 
image. ..kc^. 

20 USER INTERFACE 

Reference is now made to Fig. 8, which is a graphic representation of display^2?r^ce "is sow mari- 
illustrating a computer animation application window 140, in accordance with j ^rH^Sd^ COiVl P iirer 
embodiment of the present invention. Window 140 includes an animation area l4^"^flfi e iS °^' :i - e present inver 
contained within a frame 136 including graphic user interface controls 138. A9B&HiwileP ithin a frame 136 : 

2 5 an imation sequence is displayed in animation area 142, including female charae fer 64^^^!^^^^^ is disglayed^-i 
character^O, which preferably corre spond to respective 3D Smart Obje cts The $e$tiie$£&fri^ 0 * w.h'ich preferably c 
which F ig. 8 is taken represents a television "talk show," wherein host 160 u y^th\& &^ s * s t ak en repre ser. 
charact er 64, based on a script and on the appropriate behav iors of the associated Smart^Biects?^ fe j s ^ on ft scrip ! hi 
as described above. The script of the ta lk show appears, line by line, in a dubbing" stripl^ fbove. The. script 

3 0 while characters 64 and 160 are also seen an H ran p refprahl y also be heard t6^ ^i'theW &rs 64 .j.^Qj- - 
appropriate lines. ^ ^oprorna-e iir-- 

Frame 136 preferably comprises a 3D still image, having a transparent region*defini r ri^ 136 preferably co- 
animation area 142. As shown in Fig. 8, the transparent region is preferably non-W&ffl $fofi re? ' 142 As shown > 
Frame 136 is rendered as an overl ay, above animation area 142, so that the animation^'gSeeti 3 ^ 5 rendered as an ov er 

35 display 52 inside a correspondingly non-rectangular "window," defined by 3 the frara&v' f Re ins5de a conespohdii 
irregular shape of the animation area adds interest to the scene, and also serves to er^jp r rrSfie trie^P e of tte ts^zuox t. 
functionality of user controls 138 in relation to the scene. Using this method, animatibK'ateO^' rjf,: ^ r ^rois "? 38 
may be given any desired shape, and frame 136 may comprise any suitable still image. F6r r ';" " - ' ^ : ' /- 1 
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example, the frame may have the appearance of an auditorium, and the animation area may be 
shaped as a stage. 

Userint erface contr ols J3 8 include an on-screen joystick 144 , slider 156, selector push 
buttons 1,46, a start button 152, pause button 150, and user response button 148. These controls 
are used primarily to control the operation ot virtual "cameras," defining the 3D view from 
which the scene in animation area 142 is rendered, as described in greater detail below. User 
controls 138 are preferably themselves 3D graphic objects, which are rendered as part of the 
image of frame 136. Thus, the sizes and shapes of the user controls and the distances between 
them may be altered as desired to enhance their functionality and ease of use. 

Figs. 9A and 9B are graphic representations of display 52, illustrating changes in the 
sizes and spacing of user controls 138, responsive to scaling of animation application window 
140, in accordance with a preferred embodiment of the present invention. In Fig. 9A, window 
140 has been scaled down vertically. In consequence, the height of slider 156 is reduced to fit 
the window dimension. Similarly, in Fig. 9B, the width of window 140 is reduced, and the 
spaces between push-buttons 146 are concomitantly narrowed. Dubbing strip 154 is narrowed 
at the same time. 

The variable sizes and spacing of user controls 138 in Figs. 8, 9 A and 9B enable a user to 
operate the controls by means of pointing device 50 with greater ease and accuracy. The 
variations in size and spacing of the controls also give window 140 a more pleasing aesthetic 
appearance. By contrast, graphic user interface controls known in the art generally have fixed 
sizes and spacings, regardless of the scaling of the window in which the controls are contained. 

Figs. 10A and 10B are schematic diagrams showing the positions of 3D objects in a 3D 
animated scene 170, and illustrating- the operation of virtual cameras 172, 174 and 176 in 
rendering the scene to image area 142 of display 52 (shown in Fig. 8), in accordance with a 
preferred embodiment of the present invention. Fig. I OA is a top view of scene 170, and Fig. 
10B is a side view. The 3D objects comprise Smart Objects 64' and 160', which are rendered 
respectively as images of characters 64 and 160 in image area 142, and furniture objects 162' and 
164\ rendered respectively as couch 162 and table 1 64 in the image 

Each of virtual cameras 1-72, H4 and 176 corresponds to and defines a 3D view of scene 
170. Each camera is selected by pressing an appropriate one of push buttons 146. In a preferred 
embodiment of the present invention, five virtual cameras are used, corresponding to the five 
selection buttons 146, but for simplicity of illustration, only three cameras 172, 174 and 176 are 
shown in Fig. 10A, and only two of the cameras are shown in Fig. 10B. Thus, the view rendered 
in Fig. 8 corresponds generally to that seen by camera 1 76. 

As illustrated in Figs. 10A and 10B, each of cameras 172, 174 and 176 is capable of a 
range of virtual motions, changing the cameras' viewpoints (spatial positions), zoom angles and 
orientations. For example, as shown in Fig. I OA, camera 174 may be panned about its viewpoint 
175, as indicated by an arrow 178. The camera's zoom angle, indicated by an arrow 180, may be 
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varied between wide-angle and close-up views. The zoom is preferably controlled by shifting 
slider 156. ~ 

Camera 174 may also be moved along a straight or curved path in space, as showri^for " 
example, by an arrow 182, indicating that the camera is translating from a starting point .184 to ' ' 
5 an end point 186. Preferably, these paths are predefined, to give a well-cohtrolted ttr\ge06$ s S6. ?/ . ' ' 
camera positions, analogous to movement of real video cameras in an actual television studio. 1 ■ = 
When camera 174 is selected, a user initiates motion of the camera along the path ihdicated'by r 
arrow 182 by pressing start button 152. To stop the camera's motion, the user presses pause- 
button 150. " r ;ct 150 

10 Other camera motions are illustrated in Fig. 10B. For example, camera 172 tilts up'afuT 

down about its viewpoint 195, as indicated by an arrow 190. A point in space may ; b'e T cfi6sen, r r * " < • * 
such as a point 196, and camera 176 may be controlled to revolve about the poinf-in-aft^drbit :r: r ~~ 
beginning at a position 193, for example, and continuing as indicated by an arrow? ~K*41ii\TKe ^ -posrnon iv3," io 
cameras* tilt, pan and revolution are preferably controlled using joystick 144, as^is^finthfcn, P yv >- n-voinn 

15 described below. Likewise, camera 172 may be made to close in toward point l96V : #ong^^ l :::-- 

linear path indicated by an arrow 192, and may similarly be made to pull out, awayTrom «eene- - t -^- «• ; - ; 
170, along-an opposite path. Point 196 may be chosen to be anywhere in the 3D spac&o£scehe r * eppssiis nsth. i*r 
170, including in or adjacent to one of the objects in the scene. 1 70, including i s ;. w s-djh^n-. \o : 
It will be understood that although certain of these camera motions are described herein' 1 "* 

20 with reference to a specific one of cameras 172, 174 and 176, the motions' may' be 'a'pplied 

equally to all of the cameras, as well as to additional virtual cameras, not shown ineffl^filgiSffes^ or me cameras.^* 
which may be provided. v/mcn m.»y rv- - 

Figs. 1 1 A and 1 IB are graphic representations of display 52, illustrating the effects of the : ; " ; -r & 
camera motions and camera selection described above on images rendered in image^rSa r^J 0 ^ 9nQ camera sc.! 

25 Fig. 11A shows a view corresponding to camera 174, whose general positicfhPand Worf^angle^'s a view corresp* 
are shown schematically in Fig. 1 OA. ■• -rc shov/n 3Cncr."tica!iy in Fiu. : 

Fig. 11A also includes a schematic, outline representation of camera 172, superimp§l&d' ]A r - ! - n ^ — * 

■ - - -on the animated scene. Ordinarily, this representation of the camera is not shbVn^th^the 1 ^^ scene Grdh 
animated image area. The user may choose to display the camera outline, howeverff^ssiSt^n^"-^ area 1 n ^ user . 

30 visualizing and shifting the camera's coordinates. Fig. 1 IB shows a view "ca'ptured v 'By 3 ^ " ( ^" 
172 in the position shown in Fig. 1 1 A, i.e., Fig. 1 IB shows the view of camera nz^aft'erUhe 0 - 1 " 00 snnwr? m n- 
camera has closed in toward point 196 (Fig. 10B), as described above. v::;nsn; r.as cic-sea \n ir-v™ • >rv 

It will be appreciated that the user interface described above, comprising on-screerv" . r ;pprec»a?eo i 
controls 138 and virtual cameras 172, 174 and 176, allows a user of computer anim&ti&W'systeffi Vii,j:;j ' i-.*in-r.v 

35 40 to choose and manipulate the viewpoints from which scene 170 is rendered 5 wit It >: sulfctaniral £ ;:r »" ^ n; :- M ^v in; 
precision and flexibility and with relative ease. In interactive computer animation syslW<in$bfin' ficxibllHy ?.nd with 

in the art, a user is generally limited either to a fixed viewpoint, giving relatively little flexibility/ ~ r ■•' L 

or must maneuver a virtual camera by "free navigation" in 3D space. Free navigation is difficult 
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to control, since pointing devices^ancT on-screen controls typically have only two degrees of 

freedom, while the virtual camera has three. In accordance with the principles of the present 

invention, however, navigation in 3D space is based on selection from among predefined 

viewpoints, on zoom, pan and tilt angles centered on these viewpoints, and on movement of the 
5 viewpoints along predetermined, linear and arcuate paths. The viewpoints and paths are 

preferably pre-programmed and supplied to a user as part of an animation software package. 

Alternatively or additionally, the user may independently designate viewpoints and paths, 

preferably using pointing device 50 (Fig. 1). 

Fig. 12 is a graphic representation showing a portion of display 52, illustrating the 
10 operation of on-screen joystick 144. The joystick is operated by selecting it, preferably using 

pointing device 50, and then dragging it in a desired direction by a desired amount. In Fig. 12,. 

joystick 144 has been dragged to the left. - 

Joystick 144 has two alternative functions: Either pan and tilt of one of the virtual 

cameras that has been selected, or revolution of the selected camera about a point in scene 170. 
15 When the joystick is used to control camera revolution, left-right movement of the joystick 

drives the revolution in a horizontal plane, while up-down movement drives the revolution in a 

vertical plane. Preferably, user response button 148 is used to toggle between the tilt/pan and 

revolutionary movements of the selected camera. 

ASSOCIATIVE VISUAL SEARCH 

20 Figs. 13A arid 13B are graphic representations of display 52, schematically illustrating a 

user interface window 200 associated with a visual search engine, in accordance with a preferred 
embodiment of the present invention. The search engine is preferably used to search through a 
library of animations and/or animated objects, most preferably, 3D Smart Objects, and it is 
particularly useful in creating computer animations. But.it may, alternatively or additionally, be 

25 used in searching through databases of still images, particularly including background and border 
images for use in creating computer animations. 

Fig. 14 is a flow chart, illustrating a method of operation of the visual search engine, in 
accordance with a preferred embodiment of the present invention. 

Each item in the library or database to be searched must have at least one, and preferably 

30 a plurality, of keywords associated therewith. The keywords preferably describe different 
aspects of the item, such as its name and type, subject matter, character, appearance, style, color, 
size, etc. The keywords for each item are hierarchically ranked, with one of the keywords 
chosen to be the premier keyword for the item. Preferably, each item also has a unique name by 
which it is identified. 

35 As shown in Fig. 13 A, to begin a search, a user preferably enters a starting keyword or 

name in an entry field 202 in window 200, and then selects a "search" button 204. Based on the 
starting keyword or name, a primary search is conducted of the library or database. The search 
engine finds keywords or names associated with items in the library that match the keyword that 
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is entered, and displays the matching keywords or names in a match field 218. Preferably, the - > 

search engine includes a thesaurus, which enables the engine to select and search for other 
keywords synonymous with the starting keyword, particularly when the starting keyword is not 
found among the keywords of the library or database. 
5 Once the primary search is complete, the results are displayed in an image area 210 of ' ■ 1 I ' ' ' V ' 

window 200. An image of an item, in this case a bouquet 208, that most closely matched the 
starting keyword is displayed in a central portion 216 of the image area. Images of other, items 
that matched the starting keyword are also displayed within area 210, in a generally concentric 
arrangement around central portion 216. Images of items that matched the starting keyword 

10 more closely, such as an image of a flower 212, are displayed in closest proximity to central 

portion 216, while those that matched less closely, such as a banner 214, are displayedTarther ' * - ~~- - - r 
away. iv/av. 

In the context of the present patent application and the claims, an item is considered COtp ^ Xi °- ]it ~ P= - 
match closely a keyword that is searched for when the keyword searched for occupies' a high; u -oy> u,,,: 

1 5 rank in the hierarchy of keywords associated with the item. Generally, the higher the rahk of thfe : r : . ; o: : 
keyword searched for is in the hierarchy, the closer is the match. It will be appreciated; ^ — - - ::: : 
however, that in other preferred embodiments of the present invention, the principles v df th^- L in 01ne; !■•<£.•■-::*■ 
search engine described herein and particularly the graphic user interface associated thefeivrth^as^ >i "' i ' ■ 
exemplified by window 200, may be applied using other search algorithms known in theart. — - - 

20 Alternatively, the user may begin a search by selecting a "random" button 206. In this 

case, the search engine performs a.random search through the database or library and -pFc&dnts^a' cl * ^jgmu | c;io,:;r;.. 
random assortment of images in window 200. This random search feature is usefdPWHfcn^'tf 11 "*^ m 
user wishes to browse through the library or database so as to intuitively seek "aSsbciatidftS, 1 > ~ — ^ -^ru^i'; 
rather than using the more directed keyword search. i^^rtnsn-nc.nft r ne ,- r ...-.r^ c\rtz* 

25 Once the primary search or random search has been performed, the user visually reviews ini - primary se^rcr, 

the images in window 200. Preferably, as shown in Fig. 1 3B, when the user points B^fiSW-th^ window. 200. PscS 
images 222 with a cursor 220 (without necessarily selecting the image), the image, irT#ii%^a w '' n p cursor 220 (\- 
-man with a bouquet, is enlarged. If image 222 represents an animated object, then wKen ihe^SfeP 0 *—:^*" 751 - nl "TS e: - 
points to the image, an animation associated therewith is run. Similarly, if image 222 J r£pr&feHtf «fiage,.ar*-hnimauui 

30 a 3D object, then the enlarged image is preferably rendered as a 3D image. ' ; r w uk; w ..^cl- ■ . 

It will thus be appreciated that the properties of the search engine exemplified' by Fig!" rr; iS oe spnrec;>-. 
13B make it particularly useful for searching through a 0 library of Smart Object^ "and^mdst 1 p-: ncu^: jy u^r 
preferably 3D Smart Objects. On the other hand, it will also be understood t hat' ttie ; unique^ ^»an oq/ecis. v. 
aspects of the search engine and the user interface associated therewith will be"iuseful ^of JJ - cnu-wie ki 

35 searching through other image libraries and databases, as well D . ^iC:: : ^ iuiuu^i oiuzr muxx ;;r 

Returning to the flow chart in Fig. 14, after the primary or random search results^ ate '*° ^ :0V £> - 
o displayed, the user selects an item shown in image area 210, for example, image 222, ptefdrab!y f; f J 5 : 
by "clicking on" the item using pointing device 50. The selected item is displayed in central 
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" portion 216 of window ^200, instead of the image that was displayed there previously. The 
search engine conducts a secondary search, preferably based on the principles of keyword 
matching described above in reference to the primary search. Since the item associated with 
image 222 will generally have a different set of keywords from that used in the primary search, 
the secondary search will find new items in the library or database. The new items are displayed 
in image area 210 in the same concentric arrangement as described above. 

The user reviews the new items found in the secondary search. If the user finds a desired 
item, for example, an object to be used in an animation, that item is selected, and the search 
ends. If the desired item is not found, the user preferably selects a new one of the items in image 
area 210 that has some association with a type of item or concept that the user has in mind. This 
new item then serves as the starting point for another search, like the secondary search described, 
above. This iterative cycle of association (by the user) and search (by-the search engine) may be 
repeated indefinitely until the desired item is found. It will be appreciated that an associative 
search of this sort is useful both for finding a specific item or type of item in a library or database 
and for browsing through the library or database in search of a new, as-yet-unformulated idea. 

TRANSMITTING ANIMATION OVER A NETWORK 
Reference is now made to Fig. 15, which is a block diagram illustrating a system 
architecture 231 for transmission of an interactive computer animation over a computer network 
236, preferably over the Internet, in accordance with a preferred embodiment of the present 
invention. The animation, for exa mple, a talk sho w, as described above with reference to Fig. 8, 
is produced by a server 230 and is distributed over network 236 to multiple clients 232 and 234. 
The clients include viewers 234, who use computers such as computer 40, shown in Fig. 1, to 
receive the animation from the server and view the animation on local display 52. The clients 
may also include participants 232, who not only view the animation, but also participate in the 
animation, for example, by controlling respective avatars in the talk show. Preferably, the 
animation is based on Smart Objects, most preferably 3D Smart Objects, as described above. 

For the sake of clarity of explanation, the following description of Fig. 15 assumes that 
the animation transmitted over network 236 comprises a talk show, as illustrated and described 
above. It will be appreciated, however, that the pr inciples of the present inv ention, as described 
with reference to"~t he talk show, mayjsimilarly be applied to transmit othe r types of animated 
i nformation, entertainment and ^Svertisingjyograms o ver a network. Thus, the animation may 
comprise, for example, a game show, a soap opera, or an interactive shopping program, which 

are preferably realized using Smart Objects 

Jn_ order to transmit the talk show of Fig. 8 to one of viewers 234, the Smart Objects 
representing female character 64 and host 160 are transmitted by server 230 over network 236 
and are preferably st ored in local memory 46 of the viewer's computer 40. The Smart Objects 
need be transmitted only once" in tact, assuming host 160 appears in a series of talk show 



32 



SUBSTITUTE SHEET (RULE 26) 



WO 97/35280 



PCT/IL97/0e093 



programs transmitted by server 230, the host Smart Object may be recalled from local memory 
and need not be retransmitted over the network for each new talk show transmission. 



As a result of this use of Smart Objects in the show, the time and bandwidth needed to 
transmit each show over network 236 is substantially reduced. All that is necessary is to 



5 transmit an animat ion script. The animated Smart Objects speak their lines arid mbveiKfweeif 1 "^ 17 
a ppropriate, predetermined p ositions within an animation scene, such as scene 170 shewn in. ". 
Figs. 10A and JOB, in accordance with the script. On account of the substantial autonomy of 
the Smart Objects, substantial portions of the appearance, gestures and expressions of the 



characters are, filled in by the Smart Objects thems elves, and need not be transmitted over the " * r _ ' ?; 
10 n etwork^ The animated talk show is rendered to display 52 by a rendering engine running oh 

computer 40, as described above. ; -•*■ - - ^b^o i : o? x 

Preferably, the Smart Objects and the animation script are compatible with animation ... 

interchange tools and conventions known in the art, most preferably with VTlME*-2:<)i^s t0bi% w:;v C ;u; 

described above. Such compatibility allows viewers 234 to receive and view animations 'iisini*--^- tou\ : ya\' t 
15 commonly-available Internet browsing software, with suitable animation plug-ins, 2is r St€-^b^ r: '^ } '' : r * " f ] 

in the art. * . 

Further preferably, viewers 234 are provided with user interface controls, such as^ori^' j--=^b : y v.c.v 

screen controls 138 shown in Fig. 8. As described above, controls 138 are used 5 t6 ! v^ry : tHe°- s shown in F 

selection and viewpoints of virtual cameras 172, 174 and 176 (Figs. 10A and 10B), so-that the" - ; 
20 viewer may, for example, choose between the wide angle view of Fig. 1 1 A and theclose'-up^of ^ -J^-Jt 

Fig. 1 IB. User controls may also be provided to change other aspects- of the animation, 'sti^h ' coniruts may 

lighting or background. t . s ..i..,« > o* ■o»y±$iO-J..~ 

Viewers 234 have only limited opportunity, however, to interact with and affect* tfte Ci ^ .^^/^^^^ 

animation script . Such interaction is typically limited to indicating a selection which 'mayibeuiq \n\ti*cn 
25 t ransmitted back to the server, for example, answering a multiple choice question put lo-them&y!^A±iLiil~ { * T , 

host 160 of the talk show, by "clicking on" user response button 148. r, °st I GO of vhe. mk show, by 4 :c!i 

Participants 232 are clients of server 230 who are given a more active role if^lftF'P anr s 232 are die 

animation. For example, the participants may control respective Smart Objeri ir cKaria#ers^ 

appearing in the talk show, wherein the Smart Objects preferably comprise the : |J*arti'ci^tfs ! -the. snow, wh 
30 respective avatars. Each participant 232 preferably inputs text, along with a^suitablle^a'niniatid^^^^ -'-sen pprticr 

from the set of animations belonging to the participant's respective Smart Object * Thfc J text* and iJl annTiHt-ions beio;:. 

animation are conveyed over network 236 to server 230 and sent out. to vieiwfefs ,( 234 ; . n - •'-■onv^ypa over 

Participants 232 may further control their avatars' motions, preferably using a poiritirtg ! -dtfVJfefe/ 4 ^». !T!S y : ^--sr cut 

such as pointing device 50 (Fig. 1 ), or by other means known in the an. — p^r. t „, s rrj- v . , 5 , 

35 The local computer hardware and animation rendering software required by participate^' r <9~'p i; L5r h*rn\ 

clients 232 and by viewer clients 234 are substantially the same. Participants 232 genb7Stty^v£ n " b V v" ; e^:-r elicit $ 

additional software enabling them to participate in the animation. A further feature of lnima^6n^ Vi " r,rp - —^v 



SUBSTITUTE SHEET (RULE. 26) 



WO 97/35280 



PCT/IL97/00093 



programs transmitted ovfcr network 236 by server 230 is that one or more of viewers 23*f may be 
invited to become participants in such a program. 

Fig. 16 is a block diagram illustrating another system architecture 239 for transmission of 
computer animations over network 236, in accordance with another preferred embodiment of the 
present invention. System architecture 239 includes a network server 246, which is connected 
via network 236 to a source client 240 and a recipient client 254. The system is used by source 
client 240 to prepare an animation, for example, an animated message as described below, and 
send the animation in the form of electronic mail to recipient 254 for viewing. 

In the preferred embodiment illustrated by Fig. 16, the animation is prepared at source 
240 and sent to recipient 254 using conventions that are well known in the art. Source 240 and 
recipient 254 are preferably equipped with computers 40 as shown in Fig. 1, or with similar 
equipment. Preferably, as shown in Fig. 16, the animation sent to recipient 254 is based on the 
JAVA language and HTML file format. It will be appreciated that the principles of the present 
invention, as exemplified by Fig. 16 and described with reference thereto, may similarly be 
applied to prepare and transmit electronic mail that includes 3D animations, using VRML, for 
example. 

Source client 240 uses a message editor 242 and assets 244, comprising a library of 
animation elements, as described below, to prepare an animated message for recipient 254. The 
message is conveyed to server 246 via network 236, addressed to recipient 254, in the form of 
an encapsulated textual description, rather than as an animation, and thus substantially reduces 
transmission-time and memory needed to contain the message. 

Server 246 includes a JAVA message generator program 248. The server maintains in its 
memory JAVA classes 250, including program routines for producing animations, sound, and 
text, as are known in the art, and assets 252, generally matching the set of assets 244 of source 
client 240. Message generator 248 converts the source client's message to HTML. Message 
generator 248 receives the textual description of the animation from source client 240 and uses it 
to generate an HTML document. Server 246 transmits a URL reference to the HTML 
document, as is known in the art, infne form of an electronic mail message over network 236 to 
recipient 254. When recipient 254 opens the message, the HTML document activates a JAVA 
applet on server 246. The applet causes the animation prepared by source client 240 to be 
replayed on the recipient's computer screen, thus conveying the animated message. System 239 
allows a user of source computer 240 to compose and send an animated message to recipient 
254 in a manner analogous to sending an electronic mail letter, without the need to understand . 
or follow the conventions of the JAVA language and HTML files. 

Fig. 17A is a graphic representation of display 52, illustrating an on-screen window 260 
used by editor 242 (Fig. 16) to create an animated message, in accordance with a preferred 
embodiment of the present invention. Window 260 includes an animation area 262, which 
displays an animated scene that includes an animated character 264, text 266 and other elements 
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to be included in the message. The window also includes menus 272 and user controls 268, * l 
which are used in producing and editing the message. 

Fig. 1 7B is a flow chart illustrating a method for creating and editing the message of Jug. ' ~ 
17A, in accordance with a preferred embodiment of the present invention. A user oY~eilitbr 242 ~ J ' Z ' 
5 uses menus 272 and user controls 268 to compose the animated scene. The use~r select¥tiWk'Ad"' 7 ^ * nr * " e " r --^^ 
colors for the background and the border of the scene. Preferably, at least one animation object 1 * : 

is selected, such as character 264, along with a message, such as text 266. The Baek^bund*"*" r " " ::r - r -" ^ 
border and animation object are preferably chosen from among assets 244 using an associative ■ v - 

search engine, as described above with reference to Figs. 13 A,. 13B and 14. "if'wlirb^ £ : ~ - ib": : 

10 understood, however, that the steps of choosing the background and border are optional/andin 1 r •■ ■ - - 
the event that the user does not choose a background- and/or border, editor 242^ provides ! k^ r user 
default background and border. " ^^'~"o/t h.^r.-. r-rniirin ?.*a acrcer. 

The user ..next inputs characteristics of the motion of the animation object and vWice user nexr ,n puts c ' ; 
and/or sound effects to be included with the message. Preferably the animation objetf ^rhpfisev ^Vsurj vo inwuc 

15 a Smart Object, and the user needs only to define a path within the scene along- which ,C iHe obj&t r;L rnc - 
is to move. Further preferably, the user may assign to the animation object certain resporises l 1to 
events and user interactions, for example, defining a response of the object that is inVflkecf wlfeti S£r iKTcrsvi-ons, :or 
a recipient selects the object. In the case of Smart Objects, such responses may be a a5§fgHgPby e!ects the objeci.- Ir 
adding conditional and/or optional animations to the Smart Object, as described -affoVe with i:;0::rtI - 

20 reference to Fi« 4. " 

Once; the element s Of the scene in animation area 262 have been composed, the userMfay rne-eismenrs or me 
observe and edit the scene and make any desired changes. The user may also arfcPa33ifk?rKi edil lhe scene and 1 
scenes, in sequence, so as to create a multi-scene message. scsnftR m ^nn^rp so a- \± 

When the animated message is complete, the user may preview the animation usingW 1 Ine sn-ms-en rr^sr 
25 on-screen control bar 270, shown in Fig. I7A. The message may also be saved tS r &J^'^" ; ajr urui v*f r v, suy.- 
HTML file. When the message is ready to be sent, the user selects a M mail M button 2%van<f ! \?ie v/h£r: * 
textual description of the message is conveyed to server 246, as described above. fcziv?-} description of the me^g 
Fig. 18A is a graphic representation of display 52 belonging to recipient 254 (Fig MB), — ir ^ IZ-r^^c re*, 
showing the message conveyed from source client 240, in accordance with ^^Vglerrfep message convey? 
30 embodiment of the present invention. A window 280 on the screen of display 3 52 is creafedT>y n a r * Sth: * n " n: 

well-known lniernet browser. Animated character 264 and text message 266, as creafea k 8^Tlft inier! - si: — • 
source client, appear within an animation area 282 in window 280. ' -source client, zw.v.r v-Uhm — «r 

Fig. 18B is a flow chart illustrating a method by which the message is presenteff'W*- ! ~ - nov/ cnan 
display 52, in accordance with a preferred embodiment of the present invention. R&t?ffl6fit 254 }i * 
35 receives the electronic mail message conveyed by server 246. When the mel&geTf^enedf-a — " ro -e 

"hot link" appears in the message, as is known in the art, providing a link to a URL^fefea ! by : I : ^ rs ~ iVi :! ;: •••'•^-.p, 
server 246 for displaying the animated message created by source client 240. WhenW'Hotilhk 1 ' : v : 
is selected, the Internet browser associated with window 280 is opened (if it is not open already), 

35 

SUBSTITUTE SHEET (RULE 26) ) sv 



WO 97/35280 



PCT/IL97/00093 



and the animated message is displayed in the window, as shown in Fig. ISA " Alternatively, the 
recipient user may himself determine that the message contains an HTML file and open the 
browser to display the animation. When other, non-HTML electronic mail messages are 
received by recipient 254, they are simply read as text. 

Although the animated electronic mail message of Tig. 18A comprises a JAVA applet, 
which drives an animation that is displayed in a dedicated animation area 282, the principles of 
the present invention may be employed to encapsulate and send animated messages of other 
types, as well. For example, a 3D Smart Object may be created in a VRML-compatible format 
to serve as the animated avatar of a user. This avatar may be incorporated into an mail message 
sent by the user, so that when recipient opens the message using a VRML-compatible browser, 
the animated 3D avatar will appear on the recipient's computer display. If desired, the avatar can 
speak (or even sing) the user's mes sage. The. 3 D Smart. Object is preferably rendered as a 
Transparent 3D overlay on the browser window, as shown, for example, in F ig. 2. 

It will be appreciated that Smart Objects are particularly well suited for encapsulation 
and transmission over computer networks. The modularity of Smart Objects allows them to be 
easily customized, to present a desired animated image, such as an avatar, and/or to convey a 
message chosen by a user. Furthermore, the substantial autonomy of Smart Objects allows 
animation files that include Smart Objects to be relatively compact, since beyond the Smart 
Objects themselves, such files must generally contain only a script, and need not include details 
of the animation. 

It will moreover be appreciated that the preferred embodiments described above are cited 
by way of example, and the fiill scope of the invention is limited only by the claims 
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CLAIMS 

1. A method for producing an animation sequence on a graphic display driven by a 
computer, comprising: V 

defining an object comprising data, including a geometrical description of an animated ~ " . - 
5 character and characteristics of social behavior of the character; and ~~- " : " '* T '* ^ r J • 

animating an image of the character responsive to the characteristics. " : r - .; : . 

2. A method according to claim 1, wherein defining the object comprises programming^ * ; 
predetermined response of the character to a sensitivity condition occurring externally to"the . 

object. 

10 3. A method according to claim 2, wherein programming the predetermined response td the' :: r: ' - :rrn:v ^ 
interaction condition comprises programming a rule governing motion of the object responsive ~* • w 
to the condition. ^ S. ... 



4. A method according to claim 3, wherein defining the object comprises' defining r a c;M 
geometrical skeleton of the object characterized by a hierarchy of sub-objects c&mbct&T^ : - : " 10 " r T:: " ' 

15 joints, and wherein programming the rule governing motion comprises defining motYbns of l the ir£ - rf>fn nrr ^ r - ir :-"^n£- 

joints. jv-'- 1 : 

5. A method according to any of claims 2-4, and comprising assigning the character r ^ : — - • 
human personality type and programming a set of responses appropriate to the personality typer , ""~- 1J ' ' ; 
which set of responses includes the predetermined response to the condition. : • * ■ - - - < 

20 6. A method according to any of claims 2-5, wherein programming "the pr^etern^id Cu ' 0G accoro ^ 10 
response comprises programming a response of the character to another item whose image 1 ^ ju::.. , 
shown in the display. -^.-^r 

1. A method according to claim 6, wherein programming the response to the other itefh :t )0C ^Cvo^u^.u tU c 
comprises programming a response of the character to the other item that is ffiggerecP in^ 1 ^---^ ^ J'esnc 
25 response to proximity of the item to the character in the display. 25 r^ponsc to prcximi: y of ihe'iiem ; 

8 A method according to claim 6 or 7, wherein programming the response of the charScTef "' ,0G ; - l,,t;h: H 1 ^ 
to the other item comprises programming a response such that the character exhibit$Vfesj>'^ 
to the other item indicative of a human emotion. 



9. A method according to any of claims 6-8, wherein programming the respbnse of "thfc 
30 character to the other item comprises programming a response of the character to anitern'VvtioSfc :v :r 
image is rendered on the display substantially under the control of another program' running on~~ ^ ~ 
the computer substantially unrelated to the object. ;;;c ■ : — i -ir. 



" j ri 7- cr.o ro : n u TO 



10. A method according to any of claims 2-9, wherein programming the pr^etemfindS^ 11 "" 
response comprises programming a response of the character to being selected by a"d'sfer"^ 
35 computer graphic display. ^ . * • . -3 
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11. A method according to any of claims 2-10, wherein programming the predetermined 
response comprises programming an idle behavior undertaken by the character when a 
predetermined time has elapsed without another sensitivity condition having occurred. 

12. A method according to any of claims 2-1 1, wherein animating the image of the character ^ i - c 
5 comprises animating the image responsive to a script, wherein the script includes tfie sensitivity " : 

condition that elicits the predetermined response of the character. 

13. A method according to any of claims 2-12, and comprising transferring the object over a 
network from a source computer to a destination computer, wherein animating the image 
comprises animating an image of the character on a display associated with the 1 destination 

10 computer, in accordance with the predetermined response of the character to a~ 'sensitivity* 
condition created at the destination computer. :."~L;-w.. L , v.. 

14. A method according to any of the preceding claims, wherein defining^ the objec? c: * 
comprises defining sufficient characteristics of the behavior of the character such thaf 'TlV^imag^-^^ ^rf:£r-:~; chsrac 
is animated substantially without reference to animation instructions external to the object"""" 

15 15. A method according to any of the preceding claims, wherein anirnating : the imag"e Ptn " ^ co:r ' r : i {0 ^ 
comprises rendering a three-dimensional image of the character. czr*rsr t z?s renr.erwv' ? th; .--dirrrzn?' 

16. A method according to claim 15, wherein rendering the three-dimensional image 

comprises overlaying the image on a window in the display generated by a program' running on ' ->>^v 

the computer substantially independently of the object. - owir/u-ier 5uu^ianii^^^^ci*® 

20 17. A method according to claim 16, wherein overlaying the image on the^lndo^cbmpfisg^— °- — c - 
overlaying an image such that substantially the only portion of the-window that-is obscur6a v 'S" ! the* l!Vrf I^" 
portion directly behind the image of the character. r.nrhpr. r\w^a;\y ; : -hind ■ ! - ? 'ir^c^ of 

18. A method according to any of the preceding claims, wherein defining r <the o6jecf- lnoc ' 'according in si 
comprises defining a first object comprising a geometrical description and chardi$OTSut§ 5 o^ &lin ^ n ir a f» si object o 

25 social behavior_pf a first animated character, and comprising defining a seconcF^bjecf^^|fcfeing'or of a first anini3;-ed_cr 
a geometrical^lescription of a second animated character and characteristics of social 'Vefiffvidf*' description of a. seco: 
thereof by transferring at least some elements of the first object to the second objects - ! — «v uaiiwcitnitj.Ki isasi syme 

19. A method for producing an animation sequence on a graphic display *dnven by method for producing r 
computer, comprising; —*•-• 

30 defining a group of objects, each such object associated with a respective animated 1 -^ « giu-un o; .; t ;;ct:r: : 

character and comprising data including: 

a geometrical skeleton common to all the objects in the grouped, characterized by a ucomerncai siceierc 
a hierarchy of sub-objects connected by joints; and y -' uiirarGny oi suu-o co. 

rules governing behavior of the respective character, which rules define motions r r f ^ ^> 

35 of the joints and are interchangeable among any of a plurality of the objects; and 

animating an image of at least one of the characters responsive to the rules. . : 
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'20. A method according to claims 19, wherein defining the group of objects comprising the 
geometrical skeleton comprises defining a three-dimensional skeleton, and wherein animating the 
■ image comprises rendering a three-dimensional image. 

21. A method according to claim 19 or 20, wherein defining the group of objects comprises 
defining an accessory null within the geometrical skeleton, at which null an accessory is coupled 5 
to at least one of the objects. 

22. A method according to any of claims 19-21, wherein defining the group of objects 
comprises defining a camera null within the geometrical skeleton, for coupling a virtual camera 
to at least one of the objects so as to render an image of a scene from a point of view associated 
with the at least one object. ■ " 

23.. A method according to any of claims 19-22, wherein defining the group of objects 
comprising the rules governing behavior comprises defining rules governing behavior of a 
predetermined personality type, associated with one or more of the animated characters. 

24. A method according to any of claims 19-23, wherein defining the group of objects 
comprises defining first and second objects, wherein the second object is defined by inheritance ^ 
from the first object. 

25. A method for providing a user interface in a computer graphic display, comprising: 
displaying one or more user control icons in a window in the display; and 
scaling the one or more icons responsive to a change of scale of the window. 

26. A method according to claim 25, wherein displaying the one or more icons comprise/ 0 
displaying two icons in mutual proximity, and wherein scaling the one or more icons comprises 
changing a distance between the two icons. 

27. A method according to claim 25 or 26, wherein displaying the one or more icons 
comprises displaying an elongate icon of predetermined length, and wherein scaling the one or 
more icons comprises changing the length of the elongate icon. 25 

28. A method according to any of claims 25-27, wherein displaying the one or more user 
control icons comprises producing a frame image including the icons and having a transparent 
area, and overlaying the frame image on an animation generated on the display, such that the 
animation is framed within the transparent area. 

29. A method according to claim 28, wherein producing the frame image having the" " 
transparent area comprises producing a frame image having a non-rectangular transparent area. 

30. A method for producing an animation sequence on a graphic display driven by a 
computer, comprising: 

producing a frjame image having a non-rectangular transparent area; 
generating an animation sequence on the display; and 

39 



SUBSTITUTE SHEET (RULE 26) 



WO 97/35280 



PCT/IL97/00093 



overlaying the frame image on the animation sequence, so that the animation is framed by ~ . "" " 
the transparent area. ■ z. 

31. A method for producing an animation sequence on a graphic display driven by a" : J '""■*, * 
computer, comprising: - V • . comprising: 

5 defining a three-dimensional geometrical description of an animation scene; T 1 ^^^"-" !:, 3v,; 1 

selecting first and second reference points relative to the scene and defining a geometrical :~. y - 
path dependent on the points; ~- -c-lraz 

rendering a first image of the scene as seen from a viewpoint at a first position dri*th<P~'c ir '~„L : 

geometrical path; _ rraih: 

1 0 translating the viewpoint to a second position along the geometrical path; and •■ - " - j ' 

rendering a second image of the scene as seen from the second position. -' - "-.cr- ~ L 

32. A method according to claim 31. wherein defining the geometrical paih comprises- ■ ^^'*<u**/: 5 ^ J>.< 
defining a substantially linear path connecting the first and second reference points/ ^- " -^ - i : sci\.^:-.\\z\\-: } ..-a\. 

33. A method according to claim 31, wherein defining the geometrical path- comprises" — - ._:-.:.*■ .-L^ s 
15 defining a generally arcuate path connecting the first and second reference points. f * ■ " »<• < u^^-^y arcusie pain coi 

34. A method according to claim 31, wherein defining the geometrical path' comprises ^'Oa recording to oic 
defining a path of revolution generally centered at the second reference point^ahd--passing^n o: revciuiion wcw 
through the first reference point. ^ . „ : . . 

35. A-method according to any of claims 31-34, wherein selecting the second ref^nce^oihtthoci according to any c 
20 comprises selecting a point corresponding generally to the position of a character iijL%tfe?5&ft& sejecnng.a.point correspo 

36. A method according to any of claims 31-35, wherein translating the viewpoint comprises^co sccGrcsng io air, : 
translating the viewpoint using an on-screen joystick control. translating fne viewpoint using an or. 

37. A method according to any of claims 31-36, wherein rendering the first image oT thethod according to any 
scene as seen from the viewpoint at the first position on the geometrical paffc-confjSrisesn from the viewpoint 

25 rendering the image of the scene as seen from a first viewpoint, and cor^risirfgrideffl^gtte image of the scene-; 
second viewpoint and providing an on-screen control such that when the control is^cttvatedeanVolin and piovicling an \ 
image of the scene is rendered from the second viewpoint. . image of the scene is rerfdereB"irom 

38. A method for producing an animated overlay image on a graphic display? driven/bynatmoo Tor nrooucing an 
computer, comprising: '_Oi:: : .^i"_r, co:::pi' 

30 generating a three-dimensional animated image element; and - - £ enf> - rn ? :r: 5 n thrcc-dimcnslor, 

overlaying the animated image element on a window in the graphic display driverPby"a"yi"g :hc r.r:irr.r.:ec irr.r. 
software application substantially unrelated to the generation of the animated imageSSlSm&flS application substantially un 

39. A method according to claim 38, wherein overlaying the image element ori$?he windowihod according to clain 
comprises overlaying an image element such that the substantially unrelated software r application " " 

35 continues to run substantially as though the image element was not overlaid oh the window:* . 
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40. A method according to claim 38 or 39, wherein overlaying the image element on the 
window comprises overlaying an image element such that substantially the only portion of the 
window obscured is the portion directly behind the image element on the graphic display. 

41. A method according to any of claims 38-40, wherein overlaying the animated image 
element comprises finding a border circumscribing the image element, defining an animation 
window which is shaped to fit the border, and altering the shape of the animation window 
substantially whenever the border changes. 

42. A method according to any of claims 38-41, wherein generating the animated image 
element comprises controlling a motion of the element responsive to a characteristic of the 
display driven by the substantially unrelated software application. 

43. A method according to claim 42, wherein controlling the motion responsive to the 
characteristic of the display comprises controlling a motion responsive to a graphic icon in the 
display. 

44. A method according to claim 42 or 43, wherein generating the animated image element 
comprises defining an object corresponding to the image element and including a rule governing 
motion of the object, and wherein controlling the motion of the element comprises controlling a 
motion responsive to the rule. 

45. A method according to any of claims 38-44, and comprising transferring a data module 
corresponding to the image element over a network from a source computer to a destination 
computer, wherein generating and overlaying the image element comprise generating and 
overlaying an image on a display associated with the destination computer. 

46. A method for conveying an animation from a source computer to a destination computer, 
comprising; 

defining an object in the source computer, the object comprising a graphic description of 
an element for inclusion in the animation and a characteristic of motion of the element; 

transmitting the object from the source computer to the destination computer yia^a 
network; and 

displaying an animated image on a display driven by the destination computer, wherein 
the image includes a graphic rendition of the element, moving in accordance with the 
characteristic. 

47. A method according to claim 46, wherein transmitting the object via the network 
comprises encapsulating the object and transmitting the encapsulated object in the form of an 
electronic mail message. 

48. A method according to claim 47, wherein encapsulating the object comprises generating, 
a'textual description of the object, and wherein transmitting the object comprises transmitting the 
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textual description to a server computer, which generates an animation file based on the textual 
description and delivers the animation file to the destination computer. 

49. A method according to claim 47 or 48, wherein encapsulating the object comprises 
generating a HTML document that invokes a JAVA applet. i - £ 

50. A method according to claim 46, and.comprising transmitting a script over the network; ~ _/ " 
which script defines an animation sequence including the element, and wherein transmhtmgifie^^ 
object and transmitting the script comprise transmitting the object and the script to a plurality of 
destination computers. vi::ieio:; computers. 

51. A method according to claim 50, wherein displaying the animated image on the display"'"" 

driven by the destination computer comprises providing user controls on t hd 1 ^^SB nkt i o A h c ■ ; * 
computers for controlling rendition of the animated image. 'cmpi::^ rnr r.r.r.~.:rr.^.- : :.--.r. 

52. A method according to claim 51, wherein providing user controls comprises provKjimf™ 00 accorGing ro ci? 
on-screen control icons on the display. on-screen coraroi *jh Ur- - 

53. A method according to claim 52, and comprising scaling the icons responsive'tb a ch3nge^ iiU ^ f,ccorc:,,t:: '° c ' u ' : 
in scale of a window on the display containing the animated image. * n ot a winoow on the disn:r T . 

54. A method according to any of claims 51*53, wherein controlling rendftion ofSKe~'" nrl rrrrz ' rVi: vj ' 
animated image comprises changing a viewpoint with respect to which the image is rendered^ :! "^ r * : ' r : - - ■■• 

55. A method for finding a desired image among a library of images stored by -Vcomputer/ 1 "'"^ : : ' ;;r ' 
comprising: " " combri?" : 

displaying a fipst plurality of images from the library on a display sSPociated wit^Wfe 3 ^" 3 : - ; '~ lTyi n: " r ^ T v * 
computer; compuicr, 

selecting a first image from among the first plurality; and selecting a first imapft frnm 

searching through the library to find a second plurality of images resembling the s fi?§f mn S li^ougn hor*. 
image in one or more characteristics thereof mage ii; one or more characierisfic 

56. A method according to claim 55, and comprising displaying the f?rk ima§e and^tfiE cthod according -to cl . 
second plurality of images, such that the images of the second plurality most closely^f^semblfng 1111 ) Ui ""Hues, sue; . 

the first image in the one or more characteristics are displayed in closest proximityNo'tfie firsts - - " .•: 

image. it-n^ 

57. A method according to claim 56, wherein displaying the first image comprised displriyiffip noa sceera::- \o c::::: 
the first image in a central position on the display, and wherein displaying the^ond p ^fr9Uy r a£ e ::: " pusuion 
images comprises displaying the images of the second plurality in a generally concentric pattern ; r,:r ~* 

around the first image. . arouryj \ii<z ::rrt -™:.r-;i. 

58. A method according to any of claims 55-57, wherein displaying the imag^compfises : ''" iG ^ according ;o ~; ; \ 
displaying a cursor on the display and altering one of the images when the cursor tfeihts to the ' : 
one of the images. ~ 
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59. A method according to claim 58, wherein altering one of the images comprises animating 
the image. 

60. A method according to claim 58 or 59, wherein altering one of the images comprises 
enlarging the image. 

61. A method according to any of claims 58-60, wherein altering one of the images 
comprises displaying a three-dimensional rendition of the image. 

62. A method according to any of claims 55-61, and comprising repeating the steps of 
selecting and searching with respect to a second image from among the second plurality. 

63. A method according" to any of claims 55-62, and comprising assigning keywords to the 
images in the library, wherein searching through the library to find the second plurality of images 
resembling the first image comprises- searching to find images having at least one common 
keyword with the first image; 

64. A method according to claim 63, and comprising choosing a starting keyword, wherein 
displaying the first plurality of images comprises displaying images matching the starting 
keyword. j i 

65. A system for producing an animation sequence, comprising: 

an animation generator , which generates an animated image of a character, responsive to 
an object comprising a geometrical description of the character and characteristics of social 
behavior of the character; and 

a display, which is driven by the animation generator to display the animated image. 

66. A system according to claim 65, wherein the characteristics of social behavior of the 
character comprise a predetermined response of the character to a sensitivity condition occurring 
externally to the object. 

67. A system according to claim 66, wherein the predetermined response comprises a rule 
governing motion of the object. 

68. A system according to claim 67, wherein the geometrical description comprises a 
geometrical skeleton of the object characterized by a hierarchy of sub-objects connected by 
joints, and wherein the rule governing motion defines motions of the joints. 

69. A system according to any of claims 66-68, wherein the character has a human 
personality type associated therewith, and wherein the predetermined response belongs to a set^ 
of responses appropriate to the personality type. ♦ 

70. A system according to any of claims 66-69, wherein the predetermined response 
comprises a response of the character to an item whose image is shown on the display. 
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"71; "A system according to claim 70, wherein the predetermined response is triggered 
responsive to proximity of the item to the character on the display. 

72. A system according to claim 70 or 71, wherein the predetermined response is such that 

the character exhibits an attraction to the item. * - --* ■-- -j-ou- . - rr^; 

5 73. A system according to any of claims 70-72, wherein the animation generator renders the 

image of the item on the display responsive to another program running on the animation " 
generator substantially independently of the object. 

74. A system according to any of claims 66-73, and comprising a user input device for 
selecting the character, wherein the predetermined response comprises a response of the ■ * : 

10 character to being selected. " . :^ ( ._. 

75. A system according to any of claims 66-74, wherein the predetermined response v? 11 " r - c ^V-vr. ■ *.< . .. 
comprises an idle behavior undertaken by the character when a predetermined time hisvelap'sed " — - e V~ — 
without another sensitivity condition having occurred. y. r.;,o :.cr/j:;h ivy gondii; 

76. A system according to any of claims 66-75, wherein the animation generator ; * is ; " : "~ r . .;-r>,.,: 

15 programmed to produce the animation sequence according to a script, which includes- the^ mou^.. r><.. 
sensitivity condition that elicits the predetermined response of the character. - c -"^^ v CO" v : *i ■ t '-*\ eii::. : :!.-.- 

77. A system according to any of claims 66-76, wherein the animation generator is connected^" 1 11 aceo; '-"h *n.-- 
to a network and receives the object from a source animation generator through the network. 

78. A system according to any of claims 65-77, wherein the object comprises^suflicienfa^- '* r^w.^..^ 

20 characteristics of the behavior of the character so that the animation generator gen^afes'fh'e 1 ^ ^-mo-no^vor.^v 
animated image substantially without reference to program instructions external to the objectr ■ ul - - L.;'; 

79. A system according to any of claims 65-78, wherein the animation generator renders 
three-dimensional image of the character. iiircc-c.nicns.cr.p;; r.r.^e or • 

80. A system according to claim 79, wherein the image is overlaid on a window in^ttte dis$ay/ s ^ rt * accordi- io c!&i : 
25 generated by the animation generator in response to another program substantially independently the, rtnin^Tion s-t^cr; 

of the object. ' ■ •'■ 6 

81. A system according to claim 80, wherein the image is overlaid so that subst^htially 7 they ST,TVn ^.r.nr.-i.no -,n r\u 
only portion of the window that is obscured is the portion directly behind the imajge of 'tbt- of [he \vindo\v \hz: 
character. 

30 82. A system according to any of claims 65-81, wherein the object comprises a first object^'— ~ c.zz-:r ' : "s ;: ; 
and wherein the. animation generator generates an animated image of. anothe£ n §har&&&n the animation pen 
responsive to a second object, comprising a graphic description of the other character arid : ^ -f-ccc.vJ </0;-eci 4 c 
characteristics of social behavior thereof, defined by transferring at least some elem^'ts' of'tne ^' : - . • ; : 
first object to the second object. 
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83. A system for producing an animation sequence, comprising: - • *■ 
an animation generator, which generates an animated image of at least one character 

from a group of characters, responsive to a respective one of a group of objects, 

the objects comprising data that includes a geometrical skeleton common to all the 

objects in the group, characterized by a hierarchy of sub-objects connected by joints, and rules 

governing behavior of the respective characters, which rules define motions of the joints and are 

interchangeable among any of the objects; and 

a display, which is driven by the animation generator to display the animated image. 

84. A system according to claim 83, wherein the skeleton comprises a three-dimensional 
skeleton and the animation generator renders a three-dimensional image to the display. 

• 1 0 

85. A system according to claim 83 or 84, wherein the skeleton comprises an accessory null, 
at which null an accessory is coupled to at least one of the objects. 

86. A method according to any of claims 83-85, wherein the skeleton comprises a camera 
null, for coupling a virtual camera to at least one of the objects so as to render an image of a 
scene from a point of view associated with the at least one object. * f :i 

87. A system according to any of claims 83-86, wherein the rules governing behavior 
comprise rules governing behavior of a predetermined personality type associated with one or 
more of the animated characters. 

88. A system according to any of claims 83-87, wherein the group of objects comprises a 
first object and a second object, which is defined by inheritance from the first object. . u 

89. A system for producing graphic images, comprising: 

an animation generator, which generates a scalable graphic window with one or more 
user interface icons contained therein, such that the icons are scaled responsive to a scale of the 
window; 

a user input device for scaling the window: and 

...... 25 

a display, which is driven by the animation generator to display the window with the 

icons. 

90. A system according to claim 89, wherein the one or more icons comprise two icons in 
mutual proximity, and wherein a distance between the two icons is changed when the icons are 
scaled. 

30 

91. A system according to daini 89 or 90, wherein the one or more icons comprise an 
elongated icon of a predetermined length, which length changes when the icon is scaled. 

92. A system according to any of claims 89-91, wherein the animation generator generates a 
frame image including the icons and having a transparent area, and wherein the frame image is 
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overlaid on an animation" generated by the animation generator on the display, such that the 

animation is framed within the transparent area. Jl . * 

93. A system according to claim 92, wherein the transparent area is non-rectangular. i 

94. A system for producing an animation sequence, comprising: ' A system for producing an ; 
5 an animation generator, which generates an animation sequence and which produced a 

frame image having a non-rectangular transparent area, such that the frame image is'overlaid on - - .-J :: 
the animation sequence, whereby the animation is framed by the transparent area; and " " . 

a display, which is driven by the animation generator to display the animation sequence : ^' :r dr^ 1 
framed by the transparent area:- . - — *-« :r? -. r _ 

10 95. A system for producing an animation sequence, comprising: - - - ^- ^.£v:.:cr/. fr.r — -r::r.-r 
an animation generator, which renders animated images of a three-dimensional scener^ ::: : £: : c; . 
, each image rendered as seen from a respective viewpoint, including a first image of ,: th^ 1 s'cenfe T ^ en ^ er ^3 "as seen from ; 
seen from a first viewpoint along a predetermined geometrical path and asecond 'iffiSgirgf tKe Ttrst vii-xvpuitn aior.v 
scene as seen from a second viewpoint along the path; ' "S frhn? ; ^conr v:V-\.vp- 

15 a user input device, for selecting first and second reference points, which determine tfie r input's r^c-. tor > v 

geometrical path; and - ^"iotricsii path; and 

a display, which is driven by the animation generator to display the animated images:- -"-v-v, ; — L- : - 

96. A system according to claim 95, wherein the geometrical path comprises a substantially *'-'-ormmr r~ nr.r. 
linear path connecting the first and second reference points. . . .... _\._ 

20 97. A system according to claim 95, wherein the geometrical path conTp'rise$*6- gen^raHystem aceora^ng to ciai 
arcuate path connecting the first and second reference points. — zz~zz:ir\g \::z i^: 

98. A system according to claim 95, wherein the geometrical path comprises^ pafh §fsiem according ro.ci; 
revolution generally centered at the second reference point and passing throu'gtt'OtH&ofirsi^neraiJy centered at ; 
reference point. reverence pom:. 

25 99. A system according to any of claims 95-98. wherein the second refeftnee poifiysrem according to ai 
corresponds generally to the position of a character in the scene. .corresponds -generally to ihc posiric 

100. A system according to any of claims 95 : 99, wherein the animation generatoY^genetfafe^i^ pceorchng to any 
an on-screen joystick control that is activated using the input device for translating the VfeC&fRSilW joysnck control thai 
along the geometrical path. ::ir.r.$ in?, ^corncinca; pa;;.. 

30 101. A system according to any of claims 95-100, wherein the animation generator^ Igenefat&'tem according to any c 
an on-screen control that is activated using the input device to switch the image ren&^&y Ifie octroi xv^r ;> r^.v.v-.j.- 
animation generator between at least two different viewpoints - - . - ^zaxr^tion generator benveen lejr 

102. A system for producing an animated image, comprising: 102. * A «yc?f::Vi for pro^^ing; <:n £ 
an animation generator, which generates a three-dimensional animated image element ari^* V : ° -^r - : 
35 produces a display window driven by a software application substantially -unrelated- to^ the-:; 
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generation of the animated image element, and which overlays the animated image element on 
r/y ' the window; and 

a display, which is driven by the animation generator to display the window with the 
animated image overlaid thereon. 

5 103. A system according to claim 102, wherein the software application continues to run 
substantially as though the image element was not overlaid on the window. 

104. A system according to claim 102 or 103, wherein substantially the only portion of the 
window obscured by the overlay is the portion directly behind the image element. 

105. A system according to any of claims 102-104, wherein the animation generator finds a . 
10 border circumscribing the image element, defines an animation window shaped to fit the borders, " 

andalters the shape of the animation window whenever the borders change. 

106. A system according to any of claims 102-105, wherein the animation generator controls 
a motion of the image element responsive to a characteristic of the display window driven by the 
substantially independent software application. 

15 107. A system according to claim 106, wherein the animation generator controls the motion 
of the image element response to a graphic icon in the display. 

108. A system according to claim 106 or 107, wherein the animation generator generates the 
animated image element responsive to an object corresponding to the image element, wherein 
the object includes a" rule governing motion of the object, and the animation generator controls 

20 the motion of the image element responsive to the rule. ^ u 

109. A system according to any of claims 102-108, wherein the animation generator is 
connected to a network and receives therefrom a file corresponding to the image element. 

110. A system for conveying an animation over a network, comprising a source animation 
generator, coupled- to the network, which defines an animation file comprising an object, whic^ 

25- includes, a graphic description of an image dement for inclusion in the animation and a 
characteristic of motion of the element and transmits the object over the network in the form of 
an electronic mail message. 

111. A system for conveying an animation over a network, comprising a network animation 
server, which receives a textual description of an animation object, generates an animation file " 

30 based thereon, and delivers the animation file to a destination computer. 

112. A system according to claim 1 10 or 1 1 1, wherein the animation file comprises a set of 
parameters to be executed by a JAVA applet. 

113. A system for conveying an animation over a network, comprising a network animation 
server, which transmits over the network a script defining the animation to a plurality of" 
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destination computers, along with an object that comprises a geometrical description of a 
character for inclusion in the animation and characteristics of social behavior of the character. 

1 14. A system according to any of claims 110-113, and comprising a network, overwhich Xhi 
animations are conveyed. r,r.;r."C;r,r,? 



115. A system for viewing an animation, comprising: : '* r ' - " 

a destination animation generator , coupled to a network, which receives via the netWbfk ~ * " : 'f.o 
a script defining the animation along with an object comprising a geometrical description ofan ' r ~'" T ~< r 
image element for inclusion in the animation and a characteristic of motion of the elemdnt; arid / ; * J ! ' - ; ~' jr 
renders animated images responsive thereto; "*".-f;~r mi:::: ?f : -~r!;-\: r 

user controls, coupled to the destination animation generator , for controlling renditibn : 6F u; ! * ;T ' s ---- - ■ 
the animated images; and 

a display, which is driven by the destination animation generator to display the animafej 3 *^ '^nicr. is on 
images. ;n:a^?5 

116. A system according to claim 1 15, wherein the user controls comprise on-scV^n cofttf61 ;rnm ^r.-rnm?. r. 
icons generated by the animation generator on the display. ^ icons generated hy m-. ^un,^: 

117. A system according to claim 116, wherein the animated images are contained on % ?rc ~* 
window on the display, and wherein the icons are scaled responsive to a change in'WaleoMfte" 2 Giscinv. rsir. 
window. \~,\r>r~ 

118. A system according to any of claims 115-117, wherein the user controls *arfc : tisefd iti^" 4 acoufumg \ 
change a viewpoint with respect to which the images are rendered. cnange a viewpoint \v:;.. 

1 19. A system for searching a library of images, comprising: ' A system tor 

image storage apparatus, which stores the library of images and selects a first plurality^ iiu.a^c auua;d 
the images to be displayed; the images \r, he displays ■ 

a display, which is driven by the image storage apparatus to display the images selectfed,^:.\ vvliich'ls dri 
by the apparatus; and 25 by the apparatus; and 

a user input device, coupled to the image storage apparatus, for pointing to and selecting 1 " m P lJl device, cr 
a first image from among the first plurality of the images displayed, a » rr >a^e irom ?mcnu the 

wherein the image storage apparatus searches through the. library and selects iirte(g§se»n tnc imcce sr 
resembling the first image in one or more characteristics thereof, for inclusion ^%^^ddhd i: - — - - 
plurality of images. 3 u p\\;r?h:y n: 

120. A system according to claim 119, wherein the images included in the secdA$ pluftlftyst-n; accuEiiinu i 
that most closely resemble the first image are displayed in closest proximity ther^ r on 5 *tK£oseiy resemble i 
display. ^ dispia; v . 

121. A system according to claim 1 20, wherein the first image is displayed in a central position- - - ■« 
on the display, and wherein the images included in the second plurality are displayed ih T a' 
generally concentric pattern around the first image. ^■"•' m v u y : - " . 
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122. A system according to any of claims 119-121, wherein when the user input device is used 
to point to one of the images, the image is altered. T ~ 

123. A system according to claim 122, wherein when the user input device is used to point to 
one of the images, the image is animated. 

5 124. A system according to claim 122 or 123, wherein when the user input device is used to 
point to one of the images, the image is enlarged. 

125. A system according to any of claims 122-124, wherein when the user input device is used 
to point to one of the images, the image is rendered in three dimensions. 

126. A sy&tem according to any of claims 1 19-125, wherein the user input device is used to 
10 select a second image from among the second plurality of the images displayed, and the image 

storage apparatus searches through the library and selects images resembling the second image in 
one or more characteristics thereof 

127. A system according to any of claims 119-126, wherein the image storage apparatus 
stores keywords assigned to each of the images in the library, and wherein the image storage 

15 apparatus searches through the library and selects images having at least one keyword in 
common with the image that is selected. 

128. A system according to claim 127, wherein the image storage apparatus selects the first 
plurality of images by finding images matching a starting keyword entered by a user. 
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